-- Logs begin at Wed 2022-06-15 23:39:29 UTC, end at Thu 2022-06-16 00:39:30 UTC. -- Jun 16 00:10:18.207112 dv-cinder-845990-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 00:10:18.218151 dv-cinder-845990-2-smb devstack@keystone.service[81044]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 00:10:18 2022] *** Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: nodename: dv-cinder-845990-2-smb Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: machine: x86_64 Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: clock source: unix Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: pcre jit disabled Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: detected number of CPU cores: 4 Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: current working directory: / Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: detected binary path: /usr/bin/uwsgi-core Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: your processes number limit is 47680 Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: your memory page size is 4096 bytes Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: detected max file descriptor number: 2048 Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: lock engine: pthread robust mutexes Jun 16 00:10:18.218698 dv-cinder-845990-2-smb devstack@keystone.service[81044]: thunder lock: enabled Jun 16 00:10:18.219407 dv-cinder-845990-2-smb devstack@keystone.service[81044]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 00:10:18.219407 dv-cinder-845990-2-smb devstack@keystone.service[81044]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 00:10:18.262028 dv-cinder-845990-2-smb devstack@keystone.service[81044]: Python main interpreter initialized at 0x561b2b6e79c0 Jun 16 00:10:18.262028 dv-cinder-845990-2-smb devstack@keystone.service[81044]: python threads support enabled Jun 16 00:10:18.262028 dv-cinder-845990-2-smb devstack@keystone.service[81044]: your server socket listen backlog is limited to 100 connections Jun 16 00:10:18.262028 dv-cinder-845990-2-smb devstack@keystone.service[81044]: your mercy for graceful operations on workers is 90 seconds Jun 16 00:10:18.262354 dv-cinder-845990-2-smb devstack@keystone.service[81044]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 00:10:18.262442 dv-cinder-845990-2-smb devstack@keystone.service[81044]: *** Operational MODE: preforking *** Jun 16 00:10:18.262713 dv-cinder-845990-2-smb devstack@keystone.service[81044]: *** uWSGI is running in multiple interpreter mode *** Jun 16 00:10:18.262713 dv-cinder-845990-2-smb devstack@keystone.service[81044]: spawned uWSGI master process (pid: 81044) Jun 16 00:10:18.262902 dv-cinder-845990-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 00:10:18.264741 dv-cinder-845990-2-smb devstack@keystone.service[81044]: spawned uWSGI worker 1 (pid: 81054, cores: 1) Jun 16 00:10:18.264741 dv-cinder-845990-2-smb devstack@keystone.service[81044]: spawned uWSGI worker 2 (pid: 81055, cores: 1) Jun 16 00:10:18.264741 dv-cinder-845990-2-smb devstack@keystone.service[81044]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 00:10:23.690037 dv-cinder-845990-2-smb devstack@keystone.service[81054]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:10:23.690037 dv-cinder-845990-2-smb devstack@keystone.service[81054]: from cryptography.utils import int_from_bytes Jun 16 00:10:23.690812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:10:23.690812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: from cryptography.utils import int_from_bytes Jun 16 00:10:23.693080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:10:23.693080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: from cryptography.utils import int_from_bytes Jun 16 00:10:23.693540 dv-cinder-845990-2-smb devstack@keystone.service[81055]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:10:23.693540 dv-cinder-845990-2-smb devstack@keystone.service[81055]: from cryptography.utils import int_from_bytes Jun 16 00:10:23.741414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:10:23.741605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:10:23.741798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] command line args: [] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:10:23.742065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:10:23.742244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ================================================================================ {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:10:23.742372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:10:23.742499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] admin_token = **** {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.742584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:10:23.742745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] config_dir = [] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.742822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] command line args: [] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:10:23.742935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.743019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:10:23.743120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] config_source = [] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.743204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ================================================================================ {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:10:23.743302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] debug = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.743432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] admin_token = **** {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.743514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.744255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] config_dir = [] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.744255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.744255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] config_source = [] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.744255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] debug = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.744630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.744735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.744863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.744961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.745071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.745230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.745350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.745459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.745556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] list_limit = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.745556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] log_config_append = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.745745 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.745875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.746002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] list_limit = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.746113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] log_dir = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.746226 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] log_config_append = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.746337 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] log_file = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.746455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.746568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.746687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] log_dir = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.746687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] log_file = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.746888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.746998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.747115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.747227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.747349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.747349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.747567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.747678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.747791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.747916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.748057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.748180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.748301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.748421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.748541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.748662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.748776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.748895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.749009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.749120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.749239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.749362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.749476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.749589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.749707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.749707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.749922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.750047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.750160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.750273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.750374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] publish_errors = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.750374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.750591 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.750704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.750820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] publish_errors = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.750941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.751060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.751178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.751290 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.751407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.751536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.751662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] standard_threads = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.751775 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.751893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.752020 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.752192 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.752308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] standard_threads = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.752421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.752533 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.752645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] use_journal = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.752645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] use_json = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.752871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.752985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] use_stderr = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.753103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.753216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] use_syslog = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.753361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] use_journal = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.753474 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.753594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] use_json = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.753594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] use_stderr = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.753807 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.753925 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] use_syslog = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.754044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.754163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:10:23.754288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.754407 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.754520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.754632 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.754744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.754856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.754979 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.755099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.755219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.755342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.755456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.755574 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.755685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.755685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.755897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.755897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.756122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.756122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.756356 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.756470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.757076 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.757189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.757301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.757419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.757541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.757664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.757779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.757897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.758012 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.758130 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.758324 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.758439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.758552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.758670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.758784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.758896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.759020 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.759141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.759261 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.759375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.759487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.759609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.759729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.759849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.759992 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.760110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.760233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.760347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.760471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.760585 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.760697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.760809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.760920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.761040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.761154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.761265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.761383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.761496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.761608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.761727 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.761727 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.761937 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.762048 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.762167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.762280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.762408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.762408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.762625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.762625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.762882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.763000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.763124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.763239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.763357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.763476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.763589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.763701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.763893 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.764023 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.764146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.764263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.764376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.764487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.764608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.764722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.764834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.764945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.765057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.765169 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.765292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.765410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.765522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.765634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.765746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.765857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.765979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.766093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.766204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.766316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.766434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.766547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.766667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.766780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.766877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.766970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.766970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.767184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.767291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.767878 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.768087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.768257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.768392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.768523 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.768659 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.768823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.768959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.769101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.769229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.769365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.769503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.769641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.769770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.769907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.770036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.770171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.770299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.770438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.770574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.770704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.770849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.770980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.771109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.771249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.771379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.771507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.771635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.771763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.771952 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.772112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.772858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.772995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.773125 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.773263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.773391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.773391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.773643 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.773772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.773899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.774028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.774161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.774297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.774427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.774561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.774690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.774818 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.774946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.775073 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.775190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.775304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.775418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.775537 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.775652 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.775774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.775891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.776045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.776162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.776277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.776391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.776517 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.776634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.776748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.776863 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.776977 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.777098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.777289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.777407 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.777522 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.777635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.777755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.777871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.777994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.777994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.778235 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.778352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.778465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.778586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.778702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.778815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.778942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.779751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.780715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.780715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] auth.external = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.780715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.780715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.780715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.780715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] auth.password = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.780715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] auth.token = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.780715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.780715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.781697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.781697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.781697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.781697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.782124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.782124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] credential.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.865148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.865454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.865722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] auth.external = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.866028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.866359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.866617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.866870 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] auth.password = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.867118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] auth.token = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.867383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.867638 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.867899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.868172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.868435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.868592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.868698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.868919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.868998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.869173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] credential.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.869256 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.869430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.869510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.869690 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.869768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.869948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.870026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.870195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.870275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.870451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.870530 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.870694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.870781 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.870957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.871038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.871219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.871299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.871462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.871541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.871724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.871804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.872045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.872127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.872305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.872394 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.872579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.872660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] federation.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.872829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.872912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.873092 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.873170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.873334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] federation.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.873413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.873580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.873658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.873835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.873912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.874085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.874165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.874322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.874399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.874577 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.874655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.874823 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.874908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.875075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.875198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.875317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.875430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.875565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.875668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.875809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.875922 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.876089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.876279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.876381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.876479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.876575 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.876806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.876961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.877102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.877102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.877346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.877473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.877601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.877954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.878098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.878228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.878356 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.878494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.878623 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.878750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.878885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.879014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.879150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.879285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.879622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.879758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.879894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.880062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.880191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.880318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.880445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.880585 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.880726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.880855 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.880982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.881105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.881222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.881335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.881462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.882098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.882214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.882328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.882440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.882554 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.882660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.882776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.882889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.883002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.883114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.883233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.883355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.883476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.883591 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.883704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.883818 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.883931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.884087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.884204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.884317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.884431 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.884544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.884656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.884778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.884894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.885007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.885120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.885232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.885346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.885467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.885581 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.885695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.885814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.885930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.886042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.886172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.886288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.886401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.886514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.886627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.886740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.886861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.886977 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.887090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.887203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.887316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.887430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.887550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.887665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.887778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.887891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.888018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.888134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.888259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.888375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.888488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.888602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.888714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.888835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.888950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.889065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.889177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.889289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.889415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.889539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.889655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.889768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.889880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.889993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.890107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.890227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.890342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.890454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.890567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.890680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.890792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.890912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.891027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.891141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.891254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.891367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.891479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.891600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.891714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.891827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.891945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.892105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.892220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.892345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.892467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.892581 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.892694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.892807 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.892920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.893040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.893155 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.893269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.893382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.893494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.893607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.893728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.893843 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.893957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.894069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.894182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.894297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.894417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.894531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.894644 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.894757 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.894870 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.894983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.895105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.895219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.895333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.895446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.895559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.895672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.895794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.895908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.896036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.896150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.896264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.896377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.896503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.896619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.896732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.896845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.896958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.896958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.897178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.897178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.897469 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.897582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.897695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.897807 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] resource.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.897928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.897928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.898142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.898254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] resource.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.898367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.898480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.898601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.898716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.898828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.898940 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.899052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.899165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.899285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.899399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.899512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.899625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.899737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.899849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.900072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.900192 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.900304 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] role.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.900417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.900530 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] role.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.900644 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] role.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.900765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.900879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] role.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.900992 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.901104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.901216 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.901329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.901449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.901564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.901678 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.901794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.901908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.902028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.902143 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.902256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.902369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.902482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.902594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.902716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.902830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.902943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.903056 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.903168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.903280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.903401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.903516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.903628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.903743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.903856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.903856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.904097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.904097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.904310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.904423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.904536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.904648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.904769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.904884 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.904996 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.905109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.905221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.905332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.905453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.905568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.905688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.905802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.905915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.906028 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.906148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.906262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.906380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.906493 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.906605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.906725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.906840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.906953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.907066 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.907178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.907290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.907411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.907524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.907637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.907749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.907862 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.908016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.908144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.908260 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.908373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] token.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.908485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.908597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.908710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] token.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.908830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.908945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.909058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.909171 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.909283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.909396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.909517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.909631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.909744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.909856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.909969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.910082 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.910202 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.910316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.910429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.910541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.910653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.910765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.910886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.910999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.911113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.911224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.911336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.911448 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.911568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.911686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.911798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.911910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.912035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.912150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.912274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.912389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.912502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.connection = **** {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.912626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.912749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.913360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.connection = **** {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.913482 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.913604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.913718 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.913838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.913952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.914064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.914176 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.914290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.914402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.914523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.914637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.914749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.914861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.914973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.915086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.915207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.915322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.915434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.915547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.915659 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.915772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.915892 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.916055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.916171 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.916285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.916398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.916512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.916687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.916806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.916920 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.917033 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.917146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.917259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.917381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.917496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:10:23.917610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:10:23.917610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81054) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:10:23.947128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:23.947253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:23.947393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:23.947473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:23.947546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:23.947620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:23.955907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:23.956200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:23.984548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:23.984766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:23.985286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:23.985526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.039995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.040334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.088541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.088776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.090058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.090295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.155217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.155447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.155611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.155778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.155911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.156067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.156196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.156322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.156454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.156596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.156728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.156728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.179561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.179798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.180031 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.180166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.180294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.180419 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.180545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.180681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.180809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.180934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.181059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.181184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.181184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.181440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.191829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.192196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.204591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.204766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.204923 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.205011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.205157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.205240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.205383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.205474 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.205594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.205676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.205809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81054) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.205892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.206023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.206240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81055) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:10:24.223569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.223780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:10:24.224159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.224324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.224422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:10:24.224530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:10:24.224701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.224802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.224907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:10:24.225063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.225413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.225493 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.225675 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.225756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.225937 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.226196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.236563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.236839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.237009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.237091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.237287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.237370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.237560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.237846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.246086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.246906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.249361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.249639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.249917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.250195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.250343 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.250477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.250627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.250736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.250912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.250993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.251196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.251278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.251479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.251560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.251743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.251824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.252037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.252122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.252314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.252604 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.252880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.253147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.279629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.281266 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.281556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.282528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.284240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.284522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.286771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.287050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.287332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.289928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.290220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.290513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.294735 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.295019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.297928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.298214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.299466 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.299752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.300069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.300355 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.300628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.301108 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.301262 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.301472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.302771 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.303061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.303347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.304168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.304447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.304722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.304996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.305269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.320525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.320801 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.323876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.324177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.325310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.328688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.328946 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.329242 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.332321 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.332620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.334381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.338216 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.338556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.342141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.342473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.342773 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.343061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.343345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.343621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.343896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.345808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.346111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.346401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.346687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.346965 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.347244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.364256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.364540 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.364805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.365069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.368366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.368657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.368929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.369207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.373520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.375231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.375516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.377069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.378687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.378797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.378971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.379065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.379265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.379558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.379835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.382211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.382509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.382915 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.383212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.383492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.393195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.393478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.393772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.394053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.394332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.394605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.394880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.396830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.397116 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.397446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.397730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.398011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.398286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.398562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.412728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.416485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.417013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.419775 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.420297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.421399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.423182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.423462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.423588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.423745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.425222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.427017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.427301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.427586 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.431039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.432691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.434958 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.435886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.436204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.436489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.436601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.436765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.439843 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.440159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.440446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.440722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.446461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.446751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.447030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.450528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.450817 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.451098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.454923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=81054) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.455168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.455449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.455724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.456018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.456310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.456582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.456851 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.457224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.457495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.457766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.458035 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.458301 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.458571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81054) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.458935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=81055) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:10:24.459214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.459498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.459856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.460157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.460447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.460720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.460994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.461270 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.461641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.461920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.462197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.462470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.462744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81055) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:10:24.496639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b2b6e79c0 pid: 81054 (default app) Jun 16 00:10:24.500021 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d5cbb-32cb-406e-9a6d-48f503ece910 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:24.500333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d5cbb-32cb-406e-9a6d-48f503ece910 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:24.500614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d5cbb-32cb-406e-9a6d-48f503ece910 None None] PATH_INFO: `/v3` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:24.501260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b2b6e79c0 pid: 81055 (default app) Jun 16 00:10:24.504840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Thu Jun 16 00:10:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:32.225920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c5997-b051-4bf8-a087-96d9886ac072 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:32.226459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c5997-b051-4bf8-a087-96d9886ac072 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:32.226554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c5997-b051-4bf8-a087-96d9886ac072 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:32.230793 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:32.236243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a4c71-2562-462b-b807-9bcaf57b1a01 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:32.236688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a4c71-2562-462b-b807-9bcaf57b1a01 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:32.236779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a4c71-2562-462b-b807-9bcaf57b1a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:32.307051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: INFO dbcounter [None req-0a3a4c71-2562-462b-b807-9bcaf57b1a01 None None] Registered counter for database keystone Jun 16 00:10:32.328213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG oslo_db.sqlalchemy.engines [None req-0a3a4c71-2562-462b-b807-9bcaf57b1a01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81054) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:10:32.335110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writer thread running {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:10:32.514581 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG passlib.handlers.bcrypt [None req-0a3a4c71-2562-462b-b807-9bcaf57b1a01 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81054) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 00:10:32.515008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG passlib.handlers.bcrypt [None req-0a3a4c71-2562-462b-b807-9bcaf57b1a01 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81054) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 00:10:32.569972 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0a3a4c71-2562-462b-b807-9bcaf57b1a01 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:32.571516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0a3a4c71-2562-462b-b807-9bcaf57b1a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:32.699664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 16 00:10:32.833715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c5997-b051-4bf8-a087-96d9886ac072 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:32.903580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: INFO dbcounter [None req-cd1c5997-b051-4bf8-a087-96d9886ac072 None None] Registered counter for database keystone Jun 16 00:10:32.923403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG oslo_db.sqlalchemy.engines [None req-cd1c5997-b051-4bf8-a087-96d9886ac072 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:10:32.929781 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writer thread running {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:10:33.049798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c5997-b051-4bf8-a087-96d9886ac072 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:33.054624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a636c29-04d0-4d65-bc7e-45a06572f42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:33.055280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a636c29-04d0-4d65-bc7e-45a06572f42f admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:33.055565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a636c29-04d0-4d65-bc7e-45a06572f42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:33.055840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a636c29-04d0-4d65-bc7e-45a06572f42f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:33.064394 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a636c29-04d0-4d65-bc7e-45a06572f42f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:33.117109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2a636c29-04d0-4d65-bc7e-45a06572f42f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 00:10:33.117455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a636c29-04d0-4d65-bc7e-45a06572f42f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:33.127878 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Jun 16 00:10:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:10:33.133846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a4c71-2562-462b-b807-9bcaf57b1a01 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:33.150194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a4c71-2562-462b-b807-9bcaf57b1a01 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:33.154710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986580a7-5349-495d-9d41-370f1fda8f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:33.155815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986580a7-5349-495d-9d41-370f1fda8f63 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:33.156140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986580a7-5349-495d-9d41-370f1fda8f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:33.156498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986580a7-5349-495d-9d41-370f1fda8f63 admin admin] PATH_INFO: `/v3/projects/9f6ff6bbe76344e7a7f939e30a88483a` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:33.158038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986580a7-5349-495d-9d41-370f1fda8f63 admin admin] RBAC: Authorizing `identity:get_project(project_id=9f6ff6bbe76344e7a7f939e30a88483a)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:33.208186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: WARNING keystone.common.rbac_enforcer.enforcer [None req-986580a7-5349-495d-9d41-370f1fda8f63 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 00:10:33.208536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986580a7-5349-495d-9d41-370f1fda8f63 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:33.213802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Jun 16 00:10:33 2022] GET /identity/v3/projects/9f6ff6bbe76344e7a7f939e30a88483a => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:10:35.355693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fc9c6-18f1-47cf-afbd-053895c1bca6 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:35.356227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fc9c6-18f1-47cf-afbd-053895c1bca6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:35.356314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fc9c6-18f1-47cf-afbd-053895c1bca6 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:35.360374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:10:35.365634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa9c5-a9f8-4700-af85-558eb132e9c0 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:35.365990 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa9c5-a9f8-4700-af85-558eb132e9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:35.366205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa9c5-a9f8-4700-af85-558eb132e9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:35.384655 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-3a4fa9c5-a9f8-4700-af85-558eb132e9c0 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:35.386153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3a4fa9c5-a9f8-4700-af85-558eb132e9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:35.393935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 00:10:35.416610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fc9c6-18f1-47cf-afbd-053895c1bca6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:35.428414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fc9c6-18f1-47cf-afbd-053895c1bca6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:35.432615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14437bc2-08a2-4c27-a70d-631ce6c1e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:35.433237 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14437bc2-08a2-4c27-a70d-631ce6c1e01d admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:35.433521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14437bc2-08a2-4c27-a70d-631ce6c1e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:35.433803 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14437bc2-08a2-4c27-a70d-631ce6c1e01d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:35.441455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14437bc2-08a2-4c27-a70d-631ce6c1e01d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:35.443250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14437bc2-08a2-4c27-a70d-631ce6c1e01d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:35.451817 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Jun 16 00:10:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:10:35.456787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa9c5-a9f8-4700-af85-558eb132e9c0 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:35.465906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa9c5-a9f8-4700-af85-558eb132e9c0 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:35.470441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab69184-77e2-43df-8537-e91ddc525e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:35.471283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab69184-77e2-43df-8537-e91ddc525e6c admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:35.471569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab69184-77e2-43df-8537-e91ddc525e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:35.471847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab69184-77e2-43df-8537-e91ddc525e6c admin admin] PATH_INFO: `/v3/users/7c97d5b600dd47ebad51152c916a100a` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:35.473258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab69184-77e2-43df-8537-e91ddc525e6c admin admin] RBAC: Authorizing `identity:get_user(user_id=7c97d5b600dd47ebad51152c916a100a)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:35.475642 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab69184-77e2-43df-8537-e91ddc525e6c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:35.477199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Jun 16 00:10:35 2022] GET /identity/v3/users/7c97d5b600dd47ebad51152c916a100a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:37.612585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7d44a-057c-441f-ab51-cbf48ac23060 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:37.613219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7d44a-057c-441f-ab51-cbf48ac23060 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:37.613219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7d44a-057c-441f-ab51-cbf48ac23060 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:37.614785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:10:37.621757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5f9b-c0f7-4e68-be60-c5b4476be729 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:37.622305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5f9b-c0f7-4e68-be60-c5b4476be729 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:37.622465 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5f9b-c0f7-4e68-be60-c5b4476be729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:37.640420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-6a0c5f9b-c0f7-4e68-be60-c5b4476be729 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:37.641605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6a0c5f9b-c0f7-4e68-be60-c5b4476be729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:37.665324 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48d71e-eaee-4ed9-955f-96f338973a4b None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:37.665617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48d71e-eaee-4ed9-955f-96f338973a4b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:37.665900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48d71e-eaee-4ed9-955f-96f338973a4b None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:37.667232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:10:37.672195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13de91-5396-4c89-bf2a-8ce27f3126a1 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:37.672503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13de91-5396-4c89-bf2a-8ce27f3126a1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:37.672767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13de91-5396-4c89-bf2a-8ce27f3126a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:37.713073 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG passlib.handlers.bcrypt [None req-bf13de91-5396-4c89-bf2a-8ce27f3126a1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81055) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 00:10:37.713543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG passlib.handlers.bcrypt [None req-bf13de91-5396-4c89-bf2a-8ce27f3126a1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81055) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 00:10:37.723445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:37.746483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c5f9b-c0f7-4e68-be60-c5b4476be729 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:37.759668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-bf13de91-5396-4c89-bf2a-8ce27f3126a1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:37.761309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bf13de91-5396-4c89-bf2a-8ce27f3126a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:37.769445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:37.850732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c5f9b-c0f7-4e68-be60-c5b4476be729 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:37.861488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:10:37.884089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13de91-5396-4c89-bf2a-8ce27f3126a1 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:37.884429 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65a22c-e6fa-4c3b-a94a-9bf7e6d701e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:37.885246 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65a22c-e6fa-4c3b-a94a-9bf7e6d701e1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:37.885534 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65a22c-e6fa-4c3b-a94a-9bf7e6d701e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:37.885818 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65a22c-e6fa-4c3b-a94a-9bf7e6d701e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:37.898003 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65a22c-e6fa-4c3b-a94a-9bf7e6d701e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-bf65a22c-e6fa-4c3b-a94a-9bf7e6d701e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:37.909261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:37.910180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:10:37.911020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:10:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:10:37.917354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65a22c-e6fa-4c3b-a94a-9bf7e6d701e1 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:37.987161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13de91-5396-4c89-bf2a-8ce27f3126a1 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:37.989489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:38.002789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:38.025652 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65a22c-e6fa-4c3b-a94a-9bf7e6d701e1 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:38.030851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59057b-1eae-42b2-bfd7-1bb58d36aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:38.031759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59057b-1eae-42b2-bfd7-1bb58d36aad3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:38.032082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59057b-1eae-42b2-bfd7-1bb58d36aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:38.032433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59057b-1eae-42b2-bfd7-1bb58d36aad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:38.059101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a4eab-8809-45c5-877a-d49701d4d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:38.059762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4eab-8809-45c5-877a-d49701d4d576 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:38.060087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4eab-8809-45c5-877a-d49701d4d576 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:38.060368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4eab-8809-45c5-877a-d49701d4d576 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:38.061127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a4eab-8809-45c5-877a-d49701d4d576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:38.061443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a4eab-8809-45c5-877a-d49701d4d576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:38.062840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a4eab-8809-45c5-877a-d49701d4d576 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:38.074874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:10:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:10:38.080502 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a4eab-8809-45c5-877a-d49701d4d576 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:38.108915 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59057b-1eae-42b2-bfd7-1bb58d36aad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:38.110449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59057b-1eae-42b2-bfd7-1bb58d36aad3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:38.181207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a4eab-8809-45c5-877a-d49701d4d576 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:38.207223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:10:38.212837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59057b-1eae-42b2-bfd7-1bb58d36aad3 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:38.214008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae692e6a-4c6d-4d1b-ab69-3f39a192acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:38.214892 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae692e6a-4c6d-4d1b-ab69-3f39a192acb1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:38.215179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae692e6a-4c6d-4d1b-ab69-3f39a192acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:38.215469 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae692e6a-4c6d-4d1b-ab69-3f39a192acb1 None admin] PATH_INFO: `/v3/users/7c97d5b600dd47ebad51152c916a100a` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:38.215598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:38.217709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae692e6a-4c6d-4d1b-ab69-3f39a192acb1 None admin] RBAC: Authorizing `identity:get_user(user_id=7c97d5b600dd47ebad51152c916a100a)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:38.219319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae692e6a-4c6d-4d1b-ab69-3f39a192acb1 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:38.220987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:38 2022] GET /identity/v3/users/7c97d5b600dd47ebad51152c916a100a => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:10:38.226769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae692e6a-4c6d-4d1b-ab69-3f39a192acb1 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:38.242351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:38.312436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59057b-1eae-42b2-bfd7-1bb58d36aad3 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:38.329875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae692e6a-4c6d-4d1b-ab69-3f39a192acb1 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:38.345677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986a54a-ef2f-4e42-aa33-7aeef03c367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:38.346477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986a54a-ef2f-4e42-aa33-7aeef03c367c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:38.346766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986a54a-ef2f-4e42-aa33-7aeef03c367c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:38.347046 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986a54a-ef2f-4e42-aa33-7aeef03c367c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:38.363212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01fce-a9e8-4ef8-971e-9d4002dae928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:38.364036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01fce-a9e8-4ef8-971e-9d4002dae928 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:38.364326 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01fce-a9e8-4ef8-971e-9d4002dae928 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:38.364606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01fce-a9e8-4ef8-971e-9d4002dae928 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:38.365153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986a54a-ef2f-4e42-aa33-7aeef03c367c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:38.366381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc01fce-a9e8-4ef8-971e-9d4002dae928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:38.367114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986a54a-ef2f-4e42-aa33-7aeef03c367c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:38.367846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc01fce-a9e8-4ef8-971e-9d4002dae928 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:38.369623 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:10:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:10:38.375565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01fce-a9e8-4ef8-971e-9d4002dae928 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-a986a54a-ef2f-4e42-aa33-7aeef03c367c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:10:38.389428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:38.390318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:38.391166 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:10:38.391166 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:10:38.391166 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:10:38.391166 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:10:38.391166 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:10:38.396448 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986a54a-ef2f-4e42-aa33-7aeef03c367c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:38.452916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:38.455924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:38.476758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01fce-a9e8-4ef8-971e-9d4002dae928 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:38.497473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986a54a-ef2f-4e42-aa33-7aeef03c367c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:38.511061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bbdbf-2896-41e6-8bcd-18f046cb9ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:38.511724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bbdbf-2896-41e6-8bcd-18f046cb9ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:38.512044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bbdbf-2896-41e6-8bcd-18f046cb9ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:38.512335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bbdbf-2896-41e6-8bcd-18f046cb9ef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:38.513166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bbdbf-2896-41e6-8bcd-18f046cb9ef1 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.domain.id=default, user.id=7c97d5b600dd47ebad51152c916a100a) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:38.513483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bbdbf-2896-41e6-8bcd-18f046cb9ef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:38.514931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bbdbf-2896-41e6-8bcd-18f046cb9ef1 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:38.521510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Jun 16 00:10:38 2022] GET /identity/v3/role_assignments?user.id=7c97d5b600dd47ebad51152c916a100a&scope.domain.id=default&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:10:38.532751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86283c-42e8-4a75-832e-f6f2028b2a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:38.533460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86283c-42e8-4a75-832e-f6f2028b2a3d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:38.533746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86283c-42e8-4a75-832e-f6f2028b2a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:38.534023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86283c-42e8-4a75-832e-f6f2028b2a3d None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:38.534785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86283c-42e8-4a75-832e-f6f2028b2a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:38.535095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86283c-42e8-4a75-832e-f6f2028b2a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:38.536574 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86283c-42e8-4a75-832e-f6f2028b2a3d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:38.556687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:10:40.847989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b75c23-c245-489f-8994-8a403707d092 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:40.848907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b75c23-c245-489f-8994-8a403707d092 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:40.849388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b75c23-c245-489f-8994-8a403707d092 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:40.850987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:40.856473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa06e-f20f-4efd-97b2-b5badedcdfde None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:40.857284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa06e-f20f-4efd-97b2-b5badedcdfde None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:40.857738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa06e-f20f-4efd-97b2-b5badedcdfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:40.883415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a39fa06e-f20f-4efd-97b2-b5badedcdfde None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:40.884975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a39fa06e-f20f-4efd-97b2-b5badedcdfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:40.980682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:41.023700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b75c23-c245-489f-8994-8a403707d092 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:41.169055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd83d36-a023-4862-80a2-eb9a112d50da None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:41.169564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b75c23-c245-489f-8994-8a403707d092 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:41.169944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd83d36-a023-4862-80a2-eb9a112d50da None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:41.170419 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd83d36-a023-4862-80a2-eb9a112d50da None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:41.175763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:41.177195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7d173-ec23-4c6b-9e9a-bee62c753b4e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:41.177700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7d173-ec23-4c6b-9e9a-bee62c753b4e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:41.178266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7d173-ec23-4c6b-9e9a-bee62c753b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:41.213183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-afa7d173-ec23-4c6b-9e9a-bee62c753b4e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:41.214810 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-afa7d173-ec23-4c6b-9e9a-bee62c753b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:41.242574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3e981-748b-4504-96ce-791d1f90d882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:41.243401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3e981-748b-4504-96ce-791d1f90d882 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:41.243692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3e981-748b-4504-96ce-791d1f90d882 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:41.243994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3e981-748b-4504-96ce-791d1f90d882 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:41.266107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3e981-748b-4504-96ce-791d1f90d882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-8ca3e981-748b-4504-96ce-791d1f90d882 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:41.280199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:41.281121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:10:41.281888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:10:41.284400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 13/25] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:41.286099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b94e6b-bfa9-46fe-b292-da04b5f7e6cf None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:41.286694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b94e6b-bfa9-46fe-b292-da04b5f7e6cf None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:41.287138 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b94e6b-bfa9-46fe-b292-da04b5f7e6cf None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:41.289335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 14/26] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:41.290250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b94e6b-bfa9-46fe-b292-da04b5f7e6cf None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:41.297757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:41.311587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:41.350697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:10:41.360829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037427c7-ef27-43c5-b508-58f562c47481 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:41.361207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037427c7-ef27-43c5-b508-58f562c47481 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:41.361503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037427c7-ef27-43c5-b508-58f562c47481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:41.394696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-037427c7-ef27-43c5-b508-58f562c47481 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:41.397328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-037427c7-ef27-43c5-b508-58f562c47481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:41.467654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b94e6b-bfa9-46fe-b292-da04b5f7e6cf None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:41.539435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacda8e-b888-43f8-9eee-61a0cd03cc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:41.540145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacda8e-b888-43f8-9eee-61a0cd03cc65 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:41.540437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacda8e-b888-43f8-9eee-61a0cd03cc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:41.540720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacda8e-b888-43f8-9eee-61a0cd03cc65 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:41.541487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacda8e-b888-43f8-9eee-61a0cd03cc65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:41.541810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacda8e-b888-43f8-9eee-61a0cd03cc65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:41.543216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacda8e-b888-43f8-9eee-61a0cd03cc65 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:41.548456 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:41.549692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037427c7-ef27-43c5-b508-58f562c47481 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:41.556698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 15/29] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:41.558259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e9ff9-3418-4882-8ebf-e4e28e5e0231 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:41.558687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e9ff9-3418-4882-8ebf-e4e28e5e0231 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:41.559264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e9ff9-3418-4882-8ebf-e4e28e5e0231 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:41.560717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:41.565511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e9ff9-3418-4882-8ebf-e4e28e5e0231 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:41.647527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:41.684129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037427c7-ef27-43c5-b508-58f562c47481 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:41.688428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e9ff9-3418-4882-8ebf-e4e28e5e0231 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:41.692841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:41.726382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202deac-4477-4b3e-9dd2-b41140b56f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:41.727072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202deac-4477-4b3e-9dd2-b41140b56f57 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:41.727458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202deac-4477-4b3e-9dd2-b41140b56f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:41.727741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202deac-4477-4b3e-9dd2-b41140b56f57 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:41.728423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55bc31-f1d5-4f48-9ea7-83ed67f1ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:41.728540 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202deac-4477-4b3e-9dd2-b41140b56f57 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:41.729301 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55bc31-f1d5-4f48-9ea7-83ed67f1ea4a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:41.729590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55bc31-f1d5-4f48-9ea7-83ed67f1ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:41.729869 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55bc31-f1d5-4f48-9ea7-83ed67f1ea4a None admin] PATH_INFO: `/v3/users/7c97d5b600dd47ebad51152c916a100a` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:41.729966 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202deac-4477-4b3e-9dd2-b41140b56f57 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:41.731128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55bc31-f1d5-4f48-9ea7-83ed67f1ea4a None admin] RBAC: Authorizing `identity:get_user(user_id=7c97d5b600dd47ebad51152c916a100a)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:41.732602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55bc31-f1d5-4f48-9ea7-83ed67f1ea4a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:41.734626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 17/31] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:41 2022] GET /identity/v3/users/7c97d5b600dd47ebad51152c916a100a => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:41.736097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042223f-6685-4db5-9d94-89681c00cad4 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:41.736424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042223f-6685-4db5-9d94-89681c00cad4 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:41.736747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042223f-6685-4db5-9d94-89681c00cad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:41.755741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4042223f-6685-4db5-9d94-89681c00cad4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:41.756998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4042223f-6685-4db5-9d94-89681c00cad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:41.830842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 18/32] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:41.836221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042223f-6685-4db5-9d94-89681c00cad4 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:41.885479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 15/33] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jun 16 00:10:41 2022] POST /identity/v3/roles => generated 219 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:10:41.887303 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202deac-4477-4b3e-9dd2-b41140b56f57 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:41.909303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:41.951404 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042223f-6685-4db5-9d94-89681c00cad4 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:41.988411 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89af39-12e5-4572-9097-5d9410c4a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:41.989453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89af39-12e5-4572-9097-5d9410c4a154 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:41.989453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89af39-12e5-4572-9097-5d9410c4a154 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:41.989741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89af39-12e5-4572-9097-5d9410c4a154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:42.001784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89af39-12e5-4572-9097-5d9410c4a154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:42.003563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89af39-12e5-4572-9097-5d9410c4a154 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:42.016617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202deac-4477-4b3e-9dd2-b41140b56f57 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-eb89af39-12e5-4572-9097-5d9410c4a154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:10:42.033310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:42.034120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:42.034916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:10:42.034916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:10:42.034916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:10:42.034916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:10:42.034916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 19/34] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:42.035586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89af39-12e5-4572-9097-5d9410c4a154 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:42.060404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01347016-7b0b-477a-a382-efd27a03119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:42.061623 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01347016-7b0b-477a-a382-efd27a03119d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:42.062118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01347016-7b0b-477a-a382-efd27a03119d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:42.062707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01347016-7b0b-477a-a382-efd27a03119d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:42.064788 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01347016-7b0b-477a-a382-efd27a03119d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:42.066870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01347016-7b0b-477a-a382-efd27a03119d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:42.069115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 16/35] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:10:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:42.070276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01347016-7b0b-477a-a382-efd27a03119d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:42.110125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:42.148441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89af39-12e5-4572-9097-5d9410c4a154 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:42.165217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:42.188676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e92d77-5aa0-495c-a048-611f07e6db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:42.189365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92d77-5aa0-495c-a048-611f07e6db40 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:42.189654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92d77-5aa0-495c-a048-611f07e6db40 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:42.189935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92d77-5aa0-495c-a048-611f07e6db40 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:42.190694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e92d77-5aa0-495c-a048-611f07e6db40 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:42.192129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e92d77-5aa0-495c-a048-611f07e6db40 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:42.224669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01347016-7b0b-477a-a382-efd27a03119d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:42.272538 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecbf11-9c40-44ae-9a8d-859582a7fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:42.273191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecbf11-9c40-44ae-9a8d-859582a7fc73 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:42.273478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecbf11-9c40-44ae-9a8d-859582a7fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:42.273805 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecbf11-9c40-44ae-9a8d-859582a7fc73 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:42.274567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecbf11-9c40-44ae-9a8d-859582a7fc73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:42.274881 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecbf11-9c40-44ae-9a8d-859582a7fc73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:42.276421 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecbf11-9c40-44ae-9a8d-859582a7fc73 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:42.290363 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 17/36] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:42.291217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecbf11-9c40-44ae-9a8d-859582a7fc73 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:42.434010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 20/37] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jun 16 00:10:42 2022] POST /identity/v3/roles => generated 225 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:10:42.435164 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e92d77-5aa0-495c-a048-611f07e6db40 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:42.598090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:42.609319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecbf11-9c40-44ae-9a8d-859582a7fc73 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:42.645087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e92d77-5aa0-495c-a048-611f07e6db40 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:42.652430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ea17e-81f4-4ebc-bd20-eddc6b44aeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:42.653345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ea17e-81f4-4ebc-bd20-eddc6b44aeff None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:42.653635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ea17e-81f4-4ebc-bd20-eddc6b44aeff None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:42.653919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ea17e-81f4-4ebc-bd20-eddc6b44aeff None admin] PATH_INFO: `/v3/domains/default/users/7c97d5b600dd47ebad51152c916a100a/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:42.659120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ea17e-81f4-4ebc-bd20-eddc6b44aeff None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7c97d5b600dd47ebad51152c916a100a, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:42.660861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ea17e-81f4-4ebc-bd20-eddc6b44aeff None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:42.687823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 18/38] 10.222.0.16 () {58 vars in 1361 bytes} [Thu Jun 16 00:10:42 2022] PUT /identity/v3/domains/default/users/7c97d5b600dd47ebad51152c916a100a/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:10:42.701596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a806f6a-82c1-417b-a6d3-fd16611bbf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:42.702306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a806f6a-82c1-417b-a6d3-fd16611bbf7c None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:42.702595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a806f6a-82c1-417b-a6d3-fd16611bbf7c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:42.702878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a806f6a-82c1-417b-a6d3-fd16611bbf7c None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:42.703614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a806f6a-82c1-417b-a6d3-fd16611bbf7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:42.705381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a806f6a-82c1-417b-a6d3-fd16611bbf7c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:42.741028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 21/39] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:10:42 2022] POST /identity/v3/projects => generated 301 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:10:42.745145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121704-54e3-42a9-9a3a-95445f6d9bb9 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:42.745605 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121704-54e3-42a9-9a3a-95445f6d9bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:42.745904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73121704-54e3-42a9-9a3a-95445f6d9bb9 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:42.747425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 19/40] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:42.758566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744af60d-32f2-47e3-a7fe-11414c9dfb04 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:42.759327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744af60d-32f2-47e3-a7fe-11414c9dfb04 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:42.759957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744af60d-32f2-47e3-a7fe-11414c9dfb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:42.782802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-744af60d-32f2-47e3-a7fe-11414c9dfb04 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:42.785015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-744af60d-32f2-47e3-a7fe-11414c9dfb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:42.806443 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc52876-cdbb-46d1-b859-b9d1b0c2ca1f None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:42.806933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc52876-cdbb-46d1-b859-b9d1b0c2ca1f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:42.807140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc52876-cdbb-46d1-b859-b9d1b0c2ca1f None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:42.808879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 20/41] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:42.815077 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f367b-fe00-4a83-8adb-9a082bd9e20f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:42.816032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f367b-fe00-4a83-8adb-9a082bd9e20f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:42.816032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f367b-fe00-4a83-8adb-9a082bd9e20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:42.822990 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:42.844454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-639f367b-fe00-4a83-8adb-9a082bd9e20f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:42.849578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-639f367b-fe00-4a83-8adb-9a082bd9e20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:42.878439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:42.903326 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744af60d-32f2-47e3-a7fe-11414c9dfb04 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:42.932399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:10:42.955903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f367b-fe00-4a83-8adb-9a082bd9e20f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:43.025760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744af60d-32f2-47e3-a7fe-11414c9dfb04 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:43.061589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76e743-af00-4c97-ac7d-0ec0ac3858f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:43.062624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e743-af00-4c97-ac7d-0ec0ac3858f6 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:43.063091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e743-af00-4c97-ac7d-0ec0ac3858f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:43.063546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e743-af00-4c97-ac7d-0ec0ac3858f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:43.064503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76e743-af00-4c97-ac7d-0ec0ac3858f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:43.066084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76e743-af00-4c97-ac7d-0ec0ac3858f6 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:43.066521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:43.083438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jun 16 00:10:42 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:10:43.084670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f367b-fe00-4a83-8adb-9a082bd9e20f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:43.126367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99239c-a272-44a2-bc8b-a4bf67e1353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:43.127558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99239c-a272-44a2-bc8b-a4bf67e1353a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:43.128075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99239c-a272-44a2-bc8b-a4bf67e1353a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:43.128550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99239c-a272-44a2-bc8b-a4bf67e1353a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:43.130219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99239c-a272-44a2-bc8b-a4bf67e1353a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:43.132061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99239c-a272-44a2-bc8b-a4bf67e1353a None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:43.134374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:10:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:10:43.139886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76e743-af00-4c97-ac7d-0ec0ac3858f6 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:43.162993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:43.254131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76e743-af00-4c97-ac7d-0ec0ac3858f6 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:43.291515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f10c3-9034-421d-8c92-95a9ba76edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:43.292373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f10c3-9034-421d-8c92-95a9ba76edf2 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:43.292669 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f10c3-9034-421d-8c92-95a9ba76edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:43.292957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f10c3-9034-421d-8c92-95a9ba76edf2 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:43.293718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f10c3-9034-421d-8c92-95a9ba76edf2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:43.295192 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f10c3-9034-421d-8c92-95a9ba76edf2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:43.321778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:10:43 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:10:44.886386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6b1c7-7550-4714-975a-8713af5d2ef7 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:44.886898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6b1c7-7550-4714-975a-8713af5d2ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:44.886979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6b1c7-7550-4714-975a-8713af5d2ef7 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:44.888342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:44.893564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9b18-f075-4526-9588-10e9855bcc50 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:44.893938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9b18-f075-4526-9588-10e9855bcc50 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:44.894140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da9b18-f075-4526-9588-10e9855bcc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:44.910579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-92da9b18-f075-4526-9588-10e9855bcc50 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:44.911762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-92da9b18-f075-4526-9588-10e9855bcc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:44.973437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:44.979063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:10:45.001850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6b1c7-7550-4714-975a-8713af5d2ef7 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:45.104761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6b1c7-7550-4714-975a-8713af5d2ef7 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:45.138360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731e777-de1b-4f2f-b372-aa55f9ea15ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:45.139080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731e777-de1b-4f2f-b372-aa55f9ea15ae None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:45.139368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731e777-de1b-4f2f-b372-aa55f9ea15ae None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:45.139647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731e777-de1b-4f2f-b372-aa55f9ea15ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:45.150532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731e777-de1b-4f2f-b372-aa55f9ea15ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-9731e777-de1b-4f2f-b372-aa55f9ea15ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:45.159423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:45.160249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:10:45.161285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:45.166379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da9b18-f075-4526-9588-10e9855bcc50 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:45.263417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da9b18-f075-4526-9588-10e9855bcc50 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:45.297229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8721f-c27d-4d12-b59b-3266f8c2584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:45.297900 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8721f-c27d-4d12-b59b-3266f8c2584c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:45.298194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8721f-c27d-4d12-b59b-3266f8c2584c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:45.298476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8721f-c27d-4d12-b59b-3266f8c2584c None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:45.299229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8721f-c27d-4d12-b59b-3266f8c2584c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:45.299545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8721f-c27d-4d12-b59b-3266f8c2584c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:45.300974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8721f-c27d-4d12-b59b-3266f8c2584c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:45.309613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 26/50] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:45.315027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731e777-de1b-4f2f-b372-aa55f9ea15ae None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:45.330695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:45.417801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731e777-de1b-4f2f-b372-aa55f9ea15ae None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:45.451378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38c02c-3f26-4fa6-a108-0d222b9c7fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:45.452287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38c02c-3f26-4fa6-a108-0d222b9c7fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:45.452581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38c02c-3f26-4fa6-a108-0d222b9c7fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:45.452864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38c02c-3f26-4fa6-a108-0d222b9c7fa4 None admin] PATH_INFO: `/v3/users/7c97d5b600dd47ebad51152c916a100a` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:45.454061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38c02c-3f26-4fa6-a108-0d222b9c7fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=7c97d5b600dd47ebad51152c916a100a)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:45.455539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38c02c-3f26-4fa6-a108-0d222b9c7fa4 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:45.457214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 25/51] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:45 2022] GET /identity/v3/users/7c97d5b600dd47ebad51152c916a100a => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:45.461674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1da6e9-74c1-4451-b141-fdb2e6196625 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:45.462188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1da6e9-74c1-4451-b141-fdb2e6196625 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:45.462482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1da6e9-74c1-4451-b141-fdb2e6196625 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:45.462904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38c02c-3f26-4fa6-a108-0d222b9c7fa4 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:45.463918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 27/52] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:45.470343 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b132424-95f5-4529-9bed-62c22092735b None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:45.470764 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b132424-95f5-4529-9bed-62c22092735b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:45.471055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b132424-95f5-4529-9bed-62c22092735b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:45.487780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0b132424-95f5-4529-9bed-62c22092735b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:45.489021 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0b132424-95f5-4529-9bed-62c22092735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:45.543388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:45.545244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:45.555878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 28/53] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:10:45.565778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38c02c-3f26-4fa6-a108-0d222b9c7fa4 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:45.578908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b132424-95f5-4529-9bed-62c22092735b None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:45.600295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e0b0c-6667-4cc8-a1f6-34b96e5d3bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:45.601091 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0b0c-6667-4cc8-a1f6-34b96e5d3bdd None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:45.601382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0b0c-6667-4cc8-a1f6-34b96e5d3bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:45.601666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0b0c-6667-4cc8-a1f6-34b96e5d3bdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:45.602857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e0b0c-6667-4cc8-a1f6-34b96e5d3bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:45.604336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e0b0c-6667-4cc8-a1f6-34b96e5d3bdd None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:45.605950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 26/54] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:10:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:10:45.611508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e0b0c-6667-4cc8-a1f6-34b96e5d3bdd None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:45.676722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b132424-95f5-4529-9bed-62c22092735b None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:45.707838 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e0b0c-6667-4cc8-a1f6-34b96e5d3bdd None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:45.710626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82ac24-5628-466d-a21e-f80767993b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:45.711429 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82ac24-5628-466d-a21e-f80767993b9f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:45.711721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82ac24-5628-466d-a21e-f80767993b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:45.712041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82ac24-5628-466d-a21e-f80767993b9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:45.713253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82ac24-5628-466d-a21e-f80767993b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:45.714694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82ac24-5628-466d-a21e-f80767993b9f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:45.716597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 29/55] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:10:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:10:45.721999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82ac24-5628-466d-a21e-f80767993b9f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:45.741594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f8fb8-9e9e-4a77-8a96-6f0ba269871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:45.742248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f8fb8-9e9e-4a77-8a96-6f0ba269871f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:45.742537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f8fb8-9e9e-4a77-8a96-6f0ba269871f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:45.742819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f8fb8-9e9e-4a77-8a96-6f0ba269871f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:45.743647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f8fb8-9e9e-4a77-8a96-6f0ba269871f None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.domain.id=default, user.id=7c97d5b600dd47ebad51152c916a100a) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:45.743983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f8fb8-9e9e-4a77-8a96-6f0ba269871f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:45.745525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f8fb8-9e9e-4a77-8a96-6f0ba269871f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:45.753764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 27/56] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Jun 16 00:10:45 2022] GET /identity/v3/role_assignments?user.id=7c97d5b600dd47ebad51152c916a100a&scope.domain.id=default&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:10:45.784834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:45.827430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82ac24-5628-466d-a21e-f80767993b9f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:45.863398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c327b5-41d6-46eb-844e-a2fd123dd804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:45.864101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c327b5-41d6-46eb-844e-a2fd123dd804 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:45.864389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c327b5-41d6-46eb-844e-a2fd123dd804 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:45.864665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c327b5-41d6-46eb-844e-a2fd123dd804 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:45.865578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c327b5-41d6-46eb-844e-a2fd123dd804 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:45.867035 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c327b5-41d6-46eb-844e-a2fd123dd804 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:45.893699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 30/57] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Jun 16 00:10:45 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:10:47.991289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7adf-f18b-4dfc-8f03-dc98d8804128 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:47.991806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7adf-f18b-4dfc-8f03-dc98d8804128 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:47.991891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b7adf-f18b-4dfc-8f03-dc98d8804128 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:47.993255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 28/58] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:47.998328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe9423-52e8-4d8b-b92a-1bfc9336fc94 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:47.998734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe9423-52e8-4d8b-b92a-1bfc9336fc94 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:47.998897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe9423-52e8-4d8b-b92a-1bfc9336fc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:48.015162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-3dbe9423-52e8-4d8b-b92a-1bfc9336fc94 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:48.016372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3dbe9423-52e8-4d8b-b92a-1bfc9336fc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:48.080202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 31/59] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:48.104901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b7adf-f18b-4dfc-8f03-dc98d8804128 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:48.120599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:48.203904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b7adf-f18b-4dfc-8f03-dc98d8804128 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:48.236769 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa68574-dddb-4378-b02b-a2e9774fea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:48.237555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa68574-dddb-4378-b02b-a2e9774fea30 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:48.237849 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa68574-dddb-4378-b02b-a2e9774fea30 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:48.238138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa68574-dddb-4378-b02b-a2e9774fea30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:48.239327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa68574-dddb-4378-b02b-a2e9774fea30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:48.240843 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa68574-dddb-4378-b02b-a2e9774fea30 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:48.242497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 29/60] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:10:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:48.247792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe9423-52e8-4d8b-b92a-1bfc9336fc94 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:48.289253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:48.344420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe9423-52e8-4d8b-b92a-1bfc9336fc94 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:48.376922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9f106-7546-4e75-8452-1e32b30f1476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:48.377590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f106-7546-4e75-8452-1e32b30f1476 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:48.377884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f106-7546-4e75-8452-1e32b30f1476 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:48.378169 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f106-7546-4e75-8452-1e32b30f1476 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:48.378893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9f106-7546-4e75-8452-1e32b30f1476 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:48.380413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9f106-7546-4e75-8452-1e32b30f1476 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:48.406571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 32/61] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:10:48 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:10:51.714325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549bee-e22c-4a2e-b1c3-5b56920aeaae None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:51.715371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549bee-e22c-4a2e-b1c3-5b56920aeaae None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:51.715887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c549bee-e22c-4a2e-b1c3-5b56920aeaae None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:51.717754 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 30/62] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:51.722866 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c264d-9794-4b82-8186-e3c14e2ef474 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:51.723664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c264d-9794-4b82-8186-e3c14e2ef474 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:51.724199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c264d-9794-4b82-8186-e3c14e2ef474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:51.745120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7d2c264d-9794-4b82-8186-e3c14e2ef474 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:51.746248 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7d2c264d-9794-4b82-8186-e3c14e2ef474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:51.841893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 33/63] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:51.873082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549bee-e22c-4a2e-b1c3-5b56920aeaae None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:51.960837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c92c7-dc43-4bac-9a64-15fa90861dcc None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:51.961470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c92c7-dc43-4bac-9a64-15fa90861dcc None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:51.962000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c92c7-dc43-4bac-9a64-15fa90861dcc None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:51.963587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 34/64] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:51.969076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edbf25-dc07-40de-84cc-4eaf1b8dbbdf None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:51.969609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edbf25-dc07-40de-84cc-4eaf1b8dbbdf None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:51.970095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edbf25-dc07-40de-84cc-4eaf1b8dbbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:51.991803 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-b6edbf25-dc07-40de-84cc-4eaf1b8dbbdf None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:51.993417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b6edbf25-dc07-40de-84cc-4eaf1b8dbbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:51.999234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:52.024191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c549bee-e22c-4a2e-b1c3-5b56920aeaae None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:52.024924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:52.075656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5472524-fd5c-48fa-9974-67e26c6e64de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:52.077068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5472524-fd5c-48fa-9974-67e26c6e64de None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.077364 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5472524-fd5c-48fa-9974-67e26c6e64de None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.077649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5472524-fd5c-48fa-9974-67e26c6e64de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.085341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 35/65] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:52.087118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fa67a-1aa3-4253-bbd3-b99eee13028b None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.087614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fa67a-1aa3-4253-bbd3-b99eee13028b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.088129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fa67a-1aa3-4253-bbd3-b99eee13028b None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.089643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 36/66] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:52.096739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5472524-fd5c-48fa-9974-67e26c6e64de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:52.097355 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf7e4-7912-4383-8753-ab385b0ee11c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.097753 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf7e4-7912-4383-8753-ab385b0ee11c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.098143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf7e4-7912-4383-8753-ab385b0ee11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-e5472524-fd5c-48fa-9974-67e26c6e64de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:52.105301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:52.106126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:10:52.106969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:10:52.108857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 31/67] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:10:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:52.109445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5472524-fd5c-48fa-9974-67e26c6e64de None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:52.129066 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-18fcf7e4-7912-4383-8753-ab385b0ee11c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:52.132027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-18fcf7e4-7912-4383-8753-ab385b0ee11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:52.203245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 37/68] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:52.204405 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcf7e4-7912-4383-8753-ab385b0ee11c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:52.227337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5472524-fd5c-48fa-9974-67e26c6e64de None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:52.264135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c15222-ea56-4383-819b-b829fb139b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:52.264935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c15222-ea56-4383-819b-b829fb139b97 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.265549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c15222-ea56-4383-819b-b829fb139b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.265549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c15222-ea56-4383-819b-b829fb139b97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.274001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:52.277648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c15222-ea56-4383-819b-b829fb139b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-25c15222-ea56-4383-819b-b829fb139b97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:52.286405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:52.287789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:10:52.288681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 32/69] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:10:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:52.289907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34acb99-bd42-44f5-914c-a8642a27ce0c None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.290541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34acb99-bd42-44f5-914c-a8642a27ce0c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.290900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34acb99-bd42-44f5-914c-a8642a27ce0c None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.292429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 33/70] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:52.297392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34acb99-bd42-44f5-914c-a8642a27ce0c None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:52.306283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:52.320101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcf7e4-7912-4383-8753-ab385b0ee11c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:52.357352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f8003-80ab-4698-830a-4497bcfe2e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:52.358171 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8003-80ab-4698-830a-4497bcfe2e74 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.358435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8003-80ab-4698-830a-4497bcfe2e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.358718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f8003-80ab-4698-830a-4497bcfe2e74 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.359478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f8003-80ab-4698-830a-4497bcfe2e74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:52.359795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f8003-80ab-4698-830a-4497bcfe2e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:52.361525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f8003-80ab-4698-830a-4497bcfe2e74 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:52.375259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 38/71] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:52.375259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f8003-80ab-4698-830a-4497bcfe2e74 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:52.408666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34acb99-bd42-44f5-914c-a8642a27ce0c None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:52.445323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d7d7d-4365-47de-946b-d240a26f359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:52.446175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7d7d-4365-47de-946b-d240a26f359e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.446475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7d7d-4365-47de-946b-d240a26f359e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.446747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7d7d-4365-47de-946b-d240a26f359e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.458552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d7d7d-4365-47de-946b-d240a26f359e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-ec9d7d7d-4365-47de-946b-d240a26f359e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:52.467358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:52.468300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:10:52.469059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 34/72] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:10:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:52.470349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded22fd-a336-4922-b93e-a55b64e0c5b3 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.470349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded22fd-a336-4922-b93e-a55b64e0c5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.470349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded22fd-a336-4922-b93e-a55b64e0c5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.485504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f8003-80ab-4698-830a-4497bcfe2e74 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:52.487427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-9ded22fd-a336-4922-b93e-a55b64e0c5b3 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:52.488655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9ded22fd-a336-4922-b93e-a55b64e0c5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:52.520320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9041746-dad4-4e1a-8ac2-10f904dfed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:52.520990 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041746-dad4-4e1a-8ac2-10f904dfed03 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.521799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041746-dad4-4e1a-8ac2-10f904dfed03 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.522079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041746-dad4-4e1a-8ac2-10f904dfed03 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.522828 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9041746-dad4-4e1a-8ac2-10f904dfed03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:52.523134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9041746-dad4-4e1a-8ac2-10f904dfed03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:52.524563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9041746-dad4-4e1a-8ac2-10f904dfed03 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:52.532850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 39/73] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:10:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:52.533434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9041746-dad4-4e1a-8ac2-10f904dfed03 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:52.545492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:52.548438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:52.557678 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 35/74] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:52.558492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded22fd-a336-4922-b93e-a55b64e0c5b3 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:52.650679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9041746-dad4-4e1a-8ac2-10f904dfed03 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:52.653746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded22fd-a336-4922-b93e-a55b64e0c5b3 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:52.683543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542a49c-add9-4022-8725-c2f5ef62de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:52.684445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542a49c-add9-4022-8725-c2f5ef62de61 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.684738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542a49c-add9-4022-8725-c2f5ef62de61 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.685028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542a49c-add9-4022-8725-c2f5ef62de61 None admin] PATH_INFO: `/v3/users/7c97d5b600dd47ebad51152c916a100a` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.686247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542a49c-add9-4022-8725-c2f5ef62de61 None admin] RBAC: Authorizing `identity:get_user(user_id=7c97d5b600dd47ebad51152c916a100a)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:52.686986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5404e4-be3b-4525-b0cc-db9f68ee68ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:52.687704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5404e4-be3b-4525-b0cc-db9f68ee68ba None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.687795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542a49c-add9-4022-8725-c2f5ef62de61 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:52.688024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5404e4-be3b-4525-b0cc-db9f68ee68ba None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.688309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5404e4-be3b-4525-b0cc-db9f68ee68ba None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.689057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5404e4-be3b-4525-b0cc-db9f68ee68ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:52.689368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5404e4-be3b-4525-b0cc-db9f68ee68ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:52.689447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 40/75] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:52 2022] GET /identity/v3/users/7c97d5b600dd47ebad51152c916a100a => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:52.690592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a8b17-860a-46d3-beee-d181e26c904f None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.690751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5404e4-be3b-4525-b0cc-db9f68ee68ba None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:52.690909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a8b17-860a-46d3-beee-d181e26c904f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.691169 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a8b17-860a-46d3-beee-d181e26c904f None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.692440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 41/76] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:52.696831 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a8b17-860a-46d3-beee-d181e26c904f None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:52.708130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 36/77] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:10:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:52.708130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5404e4-be3b-4525-b0cc-db9f68ee68ba None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:52.757484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:52.778872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:52.799208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a8b17-860a-46d3-beee-d181e26c904f None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:52.805508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5404e4-be3b-4525-b0cc-db9f68ee68ba None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:52.831664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033a9db-9bfc-4fa2-8e7f-c0dc755ccc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:52.832575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a9db-9bfc-4fa2-8e7f-c0dc755ccc8a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.832871 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a9db-9bfc-4fa2-8e7f-c0dc755ccc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.833155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033a9db-9bfc-4fa2-8e7f-c0dc755ccc8a None admin] PATH_INFO: `/v3/users/addbdf471d3c4b1db21e1d0d4799f29b` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.838229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7127a-79c9-4e46-8754-a91effcc2371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:52.839012 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7127a-79c9-4e46-8754-a91effcc2371 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.839300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7127a-79c9-4e46-8754-a91effcc2371 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.839579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7127a-79c9-4e46-8754-a91effcc2371 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.846928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033a9db-9bfc-4fa2-8e7f-c0dc755ccc8a None admin] RBAC: Authorizing `identity:get_user(user_id=addbdf471d3c4b1db21e1d0d4799f29b)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:52.848435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033a9db-9bfc-4fa2-8e7f-c0dc755ccc8a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:52.850581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7127a-79c9-4e46-8754-a91effcc2371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:52.850694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 42/78] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:52 2022] GET /identity/v3/users/addbdf471d3c4b1db21e1d0d4799f29b => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:52.852791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033a9db-9bfc-4fa2-8e7f-c0dc755ccc8a None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-26e7127a-79c9-4e46-8754-a91effcc2371 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:52.858597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:52.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:10:52.860596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 37/79] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:10:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:52.861257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2451aa3-1a91-41fc-bfb9-bbdaf7641725 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.861257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2451aa3-1a91-41fc-bfb9-bbdaf7641725 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.861502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2451aa3-1a91-41fc-bfb9-bbdaf7641725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.877304 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a2451aa3-1a91-41fc-bfb9-bbdaf7641725 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:52.878470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a2451aa3-1a91-41fc-bfb9-bbdaf7641725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:52.941794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 38/80] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:52.942465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2451aa3-1a91-41fc-bfb9-bbdaf7641725 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:52.954944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033a9db-9bfc-4fa2-8e7f-c0dc755ccc8a None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:52.984576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:52.989582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed0b4e-6788-4885-a9fb-cea9737e9b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:52.990263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed0b4e-6788-4885-a9fb-cea9737e9b26 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:52.990551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed0b4e-6788-4885-a9fb-cea9737e9b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:52.990832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed0b4e-6788-4885-a9fb-cea9737e9b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:52.998968 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:53.043444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2451aa3-1a91-41fc-bfb9-bbdaf7641725 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:53.061102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed0b4e-6788-4885-a9fb-cea9737e9b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:53.062561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed0b4e-6788-4885-a9fb-cea9737e9b26 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:53.076915 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ae7b9-3abf-41fe-bce1-4209a1b5a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:53.077866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae7b9-3abf-41fe-bce1-4209a1b5a783 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:53.078158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae7b9-3abf-41fe-bce1-4209a1b5a783 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:53.078439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ae7b9-3abf-41fe-bce1-4209a1b5a783 None admin] PATH_INFO: `/v3/users/addbdf471d3c4b1db21e1d0d4799f29b` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:53.079646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ae7b9-3abf-41fe-bce1-4209a1b5a783 None admin] RBAC: Authorizing `identity:get_user(user_id=addbdf471d3c4b1db21e1d0d4799f29b)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:53.081132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ae7b9-3abf-41fe-bce1-4209a1b5a783 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:53.082918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 39/81] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:52 2022] GET /identity/v3/users/addbdf471d3c4b1db21e1d0d4799f29b => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:53.083608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ae7b9-3abf-41fe-bce1-4209a1b5a783 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:53.162699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 43/82] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:10:53.163537 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed0b4e-6788-4885-a9fb-cea9737e9b26 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:53.185553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ae7b9-3abf-41fe-bce1-4209a1b5a783 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:53.197477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:53.203153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:53.222437 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4702c4b-ae0b-4abc-bbb6-9ee4868f24ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:53.223093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4702c4b-ae0b-4abc-bbb6-9ee4868f24ba None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:53.223389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4702c4b-ae0b-4abc-bbb6-9ee4868f24ba None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:53.223713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4702c4b-ae0b-4abc-bbb6-9ee4868f24ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:53.262924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed0b4e-6788-4885-a9fb-cea9737e9b26 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:53.289669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4702c4b-ae0b-4abc-bbb6-9ee4868f24ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:53.291066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4702c4b-ae0b-4abc-bbb6-9ee4868f24ba None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:53.296647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c9a5a-c73f-4ee9-b4f3-5c55e4b26f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:53.297337 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c9a5a-c73f-4ee9-b4f3-5c55e4b26f38 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:53.297624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c9a5a-c73f-4ee9-b4f3-5c55e4b26f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:53.297902 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c9a5a-c73f-4ee9-b4f3-5c55e4b26f38 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:53.298648 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c9a5a-c73f-4ee9-b4f3-5c55e4b26f38 None admin] RBAC: Adding query filter params (name=member) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:53.299015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c9a5a-c73f-4ee9-b4f3-5c55e4b26f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:53.300428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c9a5a-c73f-4ee9-b4f3-5c55e4b26f38 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:53.308465 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 44/83] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:10:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:53.309238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c9a5a-c73f-4ee9-b4f3-5c55e4b26f38 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:53.386638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 40/84] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:10:53.387478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4702c4b-ae0b-4abc-bbb6-9ee4868f24ba None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:53.398831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:53.408676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:53.412027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c9a5a-c73f-4ee9-b4f3-5c55e4b26f38 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:53.444960 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce89b9-77ec-43cf-8c25-b395903f87bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:53.445751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce89b9-77ec-43cf-8c25-b395903f87bb None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:53.446036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce89b9-77ec-43cf-8c25-b395903f87bb None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:53.446317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce89b9-77ec-43cf-8c25-b395903f87bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:53.447475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce89b9-77ec-43cf-8c25-b395903f87bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:53.448955 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce89b9-77ec-43cf-8c25-b395903f87bb None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:53.450566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 45/85] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:10:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:53.451312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce89b9-77ec-43cf-8c25-b395903f87bb None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:53.489504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4702c4b-ae0b-4abc-bbb6-9ee4868f24ba None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:53.523525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85537b-8b3c-41ce-904c-63254907089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:53.524587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85537b-8b3c-41ce-904c-63254907089b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:53.524882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85537b-8b3c-41ce-904c-63254907089b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:53.525167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85537b-8b3c-41ce-904c-63254907089b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:53.548413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce89b9-77ec-43cf-8c25-b395903f87bb None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:53.580054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b01843-7a8b-4bef-8197-92433fa4b797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:53.580910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01843-7a8b-4bef-8197-92433fa4b797 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:53.581204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01843-7a8b-4bef-8197-92433fa4b797 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:53.581482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b01843-7a8b-4bef-8197-92433fa4b797 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:53.582686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b01843-7a8b-4bef-8197-92433fa4b797 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:53.584693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b01843-7a8b-4bef-8197-92433fa4b797 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:53.586378 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 46/86] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:10:53 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:53.587136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b01843-7a8b-4bef-8197-92433fa4b797 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:53.590687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85537b-8b3c-41ce-904c-63254907089b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:53.592585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85537b-8b3c-41ce-904c-63254907089b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:53.604527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:53.623389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:53.686923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b01843-7a8b-4bef-8197-92433fa4b797 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:53.690426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 41/87] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:10:53.691259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85537b-8b3c-41ce-904c-63254907089b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:53.720604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f10bed-6d18-47d1-9571-cf18eaf99034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:53.721477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f10bed-6d18-47d1-9571-cf18eaf99034 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:53.721766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f10bed-6d18-47d1-9571-cf18eaf99034 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:53.722056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f10bed-6d18-47d1-9571-cf18eaf99034 None admin] PATH_INFO: `/v3/users/addbdf471d3c4b1db21e1d0d4799f29b` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:53.723240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f10bed-6d18-47d1-9571-cf18eaf99034 None admin] RBAC: Authorizing `identity:get_user(user_id=addbdf471d3c4b1db21e1d0d4799f29b)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:53.725229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f10bed-6d18-47d1-9571-cf18eaf99034 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:53.726840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 47/88] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:53 2022] GET /identity/v3/users/addbdf471d3c4b1db21e1d0d4799f29b => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:53.727641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f10bed-6d18-47d1-9571-cf18eaf99034 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:53.790470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85537b-8b3c-41ce-904c-63254907089b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:53.800818 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:53.824418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f10bed-6d18-47d1-9571-cf18eaf99034 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:53.824851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61350b9-ebd8-480e-b564-b0220523009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:53.825719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61350b9-ebd8-480e-b564-b0220523009c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:53.826006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61350b9-ebd8-480e-b564-b0220523009c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:53.826288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61350b9-ebd8-480e-b564-b0220523009c None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:53.826697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:53.827524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61350b9-ebd8-480e-b564-b0220523009c None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:53.829207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61350b9-ebd8-480e-b564-b0220523009c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:53.831056 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 42/89] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:10:53 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:53.835584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61350b9-ebd8-480e-b564-b0220523009c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:53.859893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb1dc-2745-4db7-8dc3-780babb097e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:53.860598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb1dc-2745-4db7-8dc3-780babb097e7 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:53.860891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb1dc-2745-4db7-8dc3-780babb097e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:53.861176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1eb1dc-2745-4db7-8dc3-780babb097e7 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:53.861897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eb1dc-2745-4db7-8dc3-780babb097e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:53.863351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1eb1dc-2745-4db7-8dc3-780babb097e7 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:53.882485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 48/90] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:10:53 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:10:53.883332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb1dc-2745-4db7-8dc3-780babb097e7 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:53.949163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61350b9-ebd8-480e-b564-b0220523009c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:53.988247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79b1ed-c067-4b0e-95c2-4a8dd2b21527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:53.988982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79b1ed-c067-4b0e-95c2-4a8dd2b21527 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:53.989213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79b1ed-c067-4b0e-95c2-4a8dd2b21527 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:53.989498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79b1ed-c067-4b0e-95c2-4a8dd2b21527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:53.990890 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79b1ed-c067-4b0e-95c2-4a8dd2b21527 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90, user.id=7c97d5b600dd47ebad51152c916a100a) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:53.991214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79b1ed-c067-4b0e-95c2-4a8dd2b21527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:53.992731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79b1ed-c067-4b0e-95c2-4a8dd2b21527 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:54.000013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 43/91] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:10:53 2022] GET /identity/v3/role_assignments?user.id=7c97d5b600dd47ebad51152c916a100a&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:54.000013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79b1ed-c067-4b0e-95c2-4a8dd2b21527 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:54.009905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1eb1dc-2745-4db7-8dc3-780babb097e7 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:54.068532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:54.068704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d93674-c9a0-45ef-8a9b-c8832837744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:54.069469 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d93674-c9a0-45ef-8a9b-c8832837744e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:54.070237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d93674-c9a0-45ef-8a9b-c8832837744e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:54.070513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d93674-c9a0-45ef-8a9b-c8832837744e None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:54.072237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d93674-c9a0-45ef-8a9b-c8832837744e None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:54.074242 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d93674-c9a0-45ef-8a9b-c8832837744e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:54.081785 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 49/92] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:10:53 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:54.081785 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d93674-c9a0-45ef-8a9b-c8832837744e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:54.117844 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:54.153523 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79b1ed-c067-4b0e-95c2-4a8dd2b21527 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:54.197609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5539a-55aa-420d-87a1-b83317ca425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:54.198420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5539a-55aa-420d-87a1-b83317ca425d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:54.198615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5539a-55aa-420d-87a1-b83317ca425d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:54.198904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5539a-55aa-420d-87a1-b83317ca425d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:54.215738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d93674-c9a0-45ef-8a9b-c8832837744e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:54.266318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b912c-5d72-43c6-9e70-a6e26c193869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:54.266996 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b912c-5d72-43c6-9e70-a6e26c193869 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:54.267283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b912c-5d72-43c6-9e70-a6e26c193869 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:54.267559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b912c-5d72-43c6-9e70-a6e26c193869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:54.268637 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b912c-5d72-43c6-9e70-a6e26c193869 None admin] RBAC: Adding query filter params (role.id=531d1ead7d164c708ad131b14d2f9301, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90, user.id=addbdf471d3c4b1db21e1d0d4799f29b) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:54.269093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b912c-5d72-43c6-9e70-a6e26c193869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:54.270436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b912c-5d72-43c6-9e70-a6e26c193869 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:54.277832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 50/93] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:10:54 2022] GET /identity/v3/role_assignments?user.id=addbdf471d3c4b1db21e1d0d4799f29b&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:54.278439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b912c-5d72-43c6-9e70-a6e26c193869 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:54.285799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5539a-55aa-420d-87a1-b83317ca425d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:54.287369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5539a-55aa-420d-87a1-b83317ca425d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:54.359634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:54.422305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:54.432094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b912c-5d72-43c6-9e70-a6e26c193869 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:54.475802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb66e5-1d9b-4a8c-8045-b320b232381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:54.476519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb66e5-1d9b-4a8c-8045-b320b232381c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:54.476810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb66e5-1d9b-4a8c-8045-b320b232381c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:54.477090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb66e5-1d9b-4a8c-8045-b320b232381c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:54.477945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb66e5-1d9b-4a8c-8045-b320b232381c None admin] RBAC: Adding query filter params (role.id=bad10ed55f6140b882d1fdd6994f1fa8, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90, user.id=addbdf471d3c4b1db21e1d0d4799f29b) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:54.478328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb66e5-1d9b-4a8c-8045-b320b232381c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:54.479873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb66e5-1d9b-4a8c-8045-b320b232381c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:54.488036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 51/94] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:10:54 2022] GET /identity/v3/role_assignments?user.id=addbdf471d3c4b1db21e1d0d4799f29b&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=bad10ed55f6140b882d1fdd6994f1fa8 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:54.515002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 44/95] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:10:54.520953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb66e5-1d9b-4a8c-8045-b320b232381c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:54.658218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb66e5-1d9b-4a8c-8045-b320b232381c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:54.701187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba239ca-c8ae-47eb-aed8-0fb303590f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:54.702450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba239ca-c8ae-47eb-aed8-0fb303590f7c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:54.702935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba239ca-c8ae-47eb-aed8-0fb303590f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:54.703429 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba239ca-c8ae-47eb-aed8-0fb303590f7c None admin] PATH_INFO: `/v3/projects/d67b664a43f046f5921366bfc5ed2325` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:54.704903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba239ca-c8ae-47eb-aed8-0fb303590f7c None admin] RBAC: Authorizing `identity:get_project(project_id=d67b664a43f046f5921366bfc5ed2325)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:54.706571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba239ca-c8ae-47eb-aed8-0fb303590f7c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:54.708548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 52/96] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:10:54 2022] GET /identity/v3/projects/d67b664a43f046f5921366bfc5ed2325 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:54.714502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5539a-55aa-420d-87a1-b83317ca425d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:54.835012 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5539a-55aa-420d-87a1-b83317ca425d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:54.875435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63597c44-d602-40ef-af0c-2ce34d82ad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:54.876133 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597c44-d602-40ef-af0c-2ce34d82ad28 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:54.876423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597c44-d602-40ef-af0c-2ce34d82ad28 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:54.876705 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63597c44-d602-40ef-af0c-2ce34d82ad28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:54.877573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63597c44-d602-40ef-af0c-2ce34d82ad28 None admin] RBAC: Adding query filter params (role.id=531d1ead7d164c708ad131b14d2f9301, scope.project.id=d67b664a43f046f5921366bfc5ed2325, user.id=addbdf471d3c4b1db21e1d0d4799f29b) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:54.877864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63597c44-d602-40ef-af0c-2ce34d82ad28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:54.879305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63597c44-d602-40ef-af0c-2ce34d82ad28 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:54.890753 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 45/97] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:10:54 2022] GET /identity/v3/role_assignments?user.id=addbdf471d3c4b1db21e1d0d4799f29b&scope.project.id=d67b664a43f046f5921366bfc5ed2325&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:56.945053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48585d04-fc2d-4353-8bef-40495f5efada None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:56.945561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48585d04-fc2d-4353-8bef-40495f5efada None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:56.945633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48585d04-fc2d-4353-8bef-40495f5efada None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:56.947135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 53/98] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:56.952169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237bbc4-eb16-4a7d-9489-c644ffdf6a07 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:56.952555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237bbc4-eb16-4a7d-9489-c644ffdf6a07 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:56.952735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237bbc4-eb16-4a7d-9489-c644ffdf6a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:56.964079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:56.973275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-3237bbc4-eb16-4a7d-9489-c644ffdf6a07 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:56.979576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3237bbc4-eb16-4a7d-9489-c644ffdf6a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:57.070865 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 46/99] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:57.106185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48585d04-fc2d-4353-8bef-40495f5efada None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:57.152048 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:57.171549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a923-e656-4e64-af27-6d5aee9a3baf None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.171841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a923-e656-4e64-af27-6d5aee9a3baf None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.172338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1a923-e656-4e64-af27-6d5aee9a3baf None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.174101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 47/100] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:57.179542 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5fffc-7985-44d2-a395-7e11cb33b56a None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.180022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5fffc-7985-44d2-a395-7e11cb33b56a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.180445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5fffc-7985-44d2-a395-7e11cb33b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.213304 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-14a5fffc-7985-44d2-a395-7e11cb33b56a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:57.214716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-14a5fffc-7985-44d2-a395-7e11cb33b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:57.300826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48585d04-fc2d-4353-8bef-40495f5efada None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:57.329938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 48/101] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:10:57.331724 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178625-0aa7-4ec5-89c9-c2891d00fefc None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.332281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178625-0aa7-4ec5-89c9-c2891d00fefc None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.333032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178625-0aa7-4ec5-89c9-c2891d00fefc None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.335042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 49/102] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:57.340778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fd22a-71b9-4c80-9c94-d71dd7af9e1c None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.341533 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fd22a-71b9-4c80-9c94-d71dd7af9e1c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.342025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fd22a-71b9-4c80-9c94-d71dd7af9e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.361159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-8c7fd22a-71b9-4c80-9c94-d71dd7af9e1c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:57.362852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-8c7fd22a-71b9-4c80-9c94-d71dd7af9e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:57.408708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6f65e-5b55-4476-a499-4f0a70dc7fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:57.409838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6f65e-5b55-4476-a499-4f0a70dc7fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.410340 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6f65e-5b55-4476-a499-4f0a70dc7fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.410799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6f65e-5b55-4476-a499-4f0a70dc7fb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.416710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6f65e-5b55-4476-a499-4f0a70dc7fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:57.418487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6f65e-5b55-4476-a499-4f0a70dc7fb2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:57.420390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 54/103] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:10:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:57.421377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6f65e-5b55-4476-a499-4f0a70dc7fb2 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:57.440368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:57.449696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 50/104] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:57.450685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fd22a-71b9-4c80-9c94-d71dd7af9e1c None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:57.542291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:57.555470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6f65e-5b55-4476-a499-4f0a70dc7fb2 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:57.602210 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fd22a-71b9-4c80-9c94-d71dd7af9e1c None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:57.607360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3e544-cb61-4d52-ad5e-4726c6b32482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:57.608212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e544-cb61-4d52-ad5e-4726c6b32482 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.608503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e544-cb61-4d52-ad5e-4726c6b32482 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.608785 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e544-cb61-4d52-ad5e-4726c6b32482 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.623001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3e544-cb61-4d52-ad5e-4726c6b32482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-9da3e544-cb61-4d52-ad5e-4726c6b32482 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:57.631820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:57.632861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:10:57.633684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 55/105] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:10:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:57.634929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2aba6-781b-44dc-a6b0-3382c8b0e609 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.635220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2aba6-781b-44dc-a6b0-3382c8b0e609 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.635498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2aba6-781b-44dc-a6b0-3382c8b0e609 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.636863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 56/106] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:57.640882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2aba6-781b-44dc-a6b0-3382c8b0e609 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:57.644136 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164cada-e613-4890-b692-f9cb94506f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:57.644809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164cada-e613-4890-b692-f9cb94506f0f None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.645106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164cada-e613-4890-b692-f9cb94506f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.645391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164cada-e613-4890-b692-f9cb94506f0f None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.646182 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164cada-e613-4890-b692-f9cb94506f0f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:57.647689 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164cada-e613-4890-b692-f9cb94506f0f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:57.676007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 51/107] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:10:57 2022] POST /identity/v3/projects => generated 302 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:10:57.677150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127c74-d07a-49c1-9f6c-4a1d11f80736 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.678000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127c74-d07a-49c1-9f6c-4a1d11f80736 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.678292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127c74-d07a-49c1-9f6c-4a1d11f80736 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.679566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 52/108] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:57.680340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127c74-d07a-49c1-9f6c-4a1d11f80736 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:57.755173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:57.775702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2aba6-781b-44dc-a6b0-3382c8b0e609 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:57.819250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98dca5-f82f-4be6-8722-8dd51b24cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:57.820092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98dca5-f82f-4be6-8722-8dd51b24cff4 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.820392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98dca5-f82f-4be6-8722-8dd51b24cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.820679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98dca5-f82f-4be6-8722-8dd51b24cff4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.838446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98dca5-f82f-4be6-8722-8dd51b24cff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:57.845759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127c74-d07a-49c1-9f6c-4a1d11f80736 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-aa98dca5-f82f-4be6-8722-8dd51b24cff4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:57.847137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:57.847983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:10:57.848741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:10:57.849935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 57/109] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:10:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:57.850968 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aefb21-0e8a-479b-9842-20689d9dd440 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.851266 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aefb21-0e8a-479b-9842-20689d9dd440 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.851556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aefb21-0e8a-479b-9842-20689d9dd440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.874115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-76aefb21-0e8a-479b-9842-20689d9dd440 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:57.875450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-76aefb21-0e8a-479b-9842-20689d9dd440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:57.884272 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:57.891688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341533fc-8393-4fa8-be93-4fc70230bb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:57.892649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341533fc-8393-4fa8-be93-4fc70230bb1d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.893241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341533fc-8393-4fa8-be93-4fc70230bb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.893716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341533fc-8393-4fa8-be93-4fc70230bb1d None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.894642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341533fc-8393-4fa8-be93-4fc70230bb1d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:57.895126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341533fc-8393-4fa8-be93-4fc70230bb1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:57.897225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341533fc-8393-4fa8-be93-4fc70230bb1d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:57.907896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 53/110] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:10:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:57.909682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5c46-8a0f-4a38-a433-d6320967e4e4 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:57.910170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5c46-8a0f-4a38-a433-d6320967e4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:57.910641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d5c46-8a0f-4a38-a433-d6320967e4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:57.927946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c97d5c46-8a0f-4a38-a433-d6320967e4e4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:57.929257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c97d5c46-8a0f-4a38-a433-d6320967e4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:57.959998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 58/111] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:57.961646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aefb21-0e8a-479b-9842-20689d9dd440 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:58.015434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 54/112] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:58.016422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d5c46-8a0f-4a38-a433-d6320967e4e4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:58.083203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:58.084522 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aefb21-0e8a-479b-9842-20689d9dd440 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:58.120139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40c0b6-a5cb-4333-99bb-92d23bc9f36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:58.120826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c0b6-a5cb-4333-99bb-92d23bc9f36a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:58.121113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c0b6-a5cb-4333-99bb-92d23bc9f36a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:58.121395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c0b6-a5cb-4333-99bb-92d23bc9f36a None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:58.122145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c0b6-a5cb-4333-99bb-92d23bc9f36a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:58.122457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c0b6-a5cb-4333-99bb-92d23bc9f36a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:58.124285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c0b6-a5cb-4333-99bb-92d23bc9f36a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:58.135104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 59/113] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:10:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:58.136261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40c0b6-a5cb-4333-99bb-92d23bc9f36a None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:58.148551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:58.153736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d5c46-8a0f-4a38-a433-d6320967e4e4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:58.194515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fdc61-ae3b-4136-aaa3-77208c26f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:58.195901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fdc61-ae3b-4136-aaa3-77208c26f90c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:58.196394 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fdc61-ae3b-4136-aaa3-77208c26f90c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:58.196887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fdc61-ae3b-4136-aaa3-77208c26f90c None admin] PATH_INFO: `/v3/users/9c10ad892c5b42dda230c4a3f76a6f6d` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:58.214780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fdc61-ae3b-4136-aaa3-77208c26f90c None admin] RBAC: Authorizing `identity:get_user(user_id=9c10ad892c5b42dda230c4a3f76a6f6d)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:58.216803 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fdc61-ae3b-4136-aaa3-77208c26f90c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:58.219247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 55/114] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:58 2022] GET /identity/v3/users/9c10ad892c5b42dda230c4a3f76a6f6d => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:58.220264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fdc61-ae3b-4136-aaa3-77208c26f90c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:58.260949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40c0b6-a5cb-4333-99bb-92d23bc9f36a None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:58.295223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dff62-e2ef-46f0-bc42-d313207979e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:58.296048 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dff62-e2ef-46f0-bc42-d313207979e5 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:58.296336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dff62-e2ef-46f0-bc42-d313207979e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:58.297193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dff62-e2ef-46f0-bc42-d313207979e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:58.308029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dff62-e2ef-46f0-bc42-d313207979e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-2e2dff62-e2ef-46f0-bc42-d313207979e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:58.315685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:58.316719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:10:58.317481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 60/115] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:58.318616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dff62-e2ef-46f0-bc42-d313207979e5 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:58.329203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:58.333466 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fdc61-ae3b-4136-aaa3-77208c26f90c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:58.371043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf896fe3-fc93-46dc-8cf5-c4a3b2de6605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:58.371944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896fe3-fc93-46dc-8cf5-c4a3b2de6605 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:58.372345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896fe3-fc93-46dc-8cf5-c4a3b2de6605 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:58.372700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896fe3-fc93-46dc-8cf5-c4a3b2de6605 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:58.383240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf896fe3-fc93-46dc-8cf5-c4a3b2de6605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:58.385898 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-bf896fe3-fc93-46dc-8cf5-c4a3b2de6605 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:58.391229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:58.392248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:10:58.393069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 56/116] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:58.393689 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf896fe3-fc93-46dc-8cf5-c4a3b2de6605 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:58.432594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dff62-e2ef-46f0-bc42-d313207979e5 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:58.469801 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67925a4-92f6-47a8-819a-0f6af3f6ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:58.470932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67925a4-92f6-47a8-819a-0f6af3f6ee10 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:58.471374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67925a4-92f6-47a8-819a-0f6af3f6ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:58.471811 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67925a4-92f6-47a8-819a-0f6af3f6ee10 None admin] PATH_INFO: `/v3/users/addbdf471d3c4b1db21e1d0d4799f29b` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:58.473231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67925a4-92f6-47a8-819a-0f6af3f6ee10 None admin] RBAC: Authorizing `identity:get_user(user_id=addbdf471d3c4b1db21e1d0d4799f29b)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:58.474731 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67925a4-92f6-47a8-819a-0f6af3f6ee10 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:58.481234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 61/117] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:58 2022] GET /identity/v3/users/addbdf471d3c4b1db21e1d0d4799f29b => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:58.481234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ebaf0-bfef-4fd0-89c2-f4f7e7db720c None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:58.481234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ebaf0-bfef-4fd0-89c2-f4f7e7db720c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:58.481234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ebaf0-bfef-4fd0-89c2-f4f7e7db720c None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:58.481234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 62/118] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:10:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:10:58.481234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ebaf0-bfef-4fd0-89c2-f4f7e7db720c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:58.514568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf896fe3-fc93-46dc-8cf5-c4a3b2de6605 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:58.548992 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c28c9-ef08-4105-8cd0-4114a8529ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:58.549647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c28c9-ef08-4105-8cd0-4114a8529ebb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:58.549940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c28c9-ef08-4105-8cd0-4114a8529ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:58.550315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c28c9-ef08-4105-8cd0-4114a8529ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:58.577543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:58.599543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ebaf0-bfef-4fd0-89c2-f4f7e7db720c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:58.618883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c28c9-ef08-4105-8cd0-4114a8529ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:58.620392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c28c9-ef08-4105-8cd0-4114a8529ebb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:58.630172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:58.635877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec525161-3143-45f7-b907-58a82f343139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:58.636650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec525161-3143-45f7-b907-58a82f343139 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:58.636931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec525161-3143-45f7-b907-58a82f343139 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:58.637214 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec525161-3143-45f7-b907-58a82f343139 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:58.637960 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec525161-3143-45f7-b907-58a82f343139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:58.638276 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec525161-3143-45f7-b907-58a82f343139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:58.639631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec525161-3143-45f7-b907-58a82f343139 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:58.652963 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 63/119] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:58.652963 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec525161-3143-45f7-b907-58a82f343139 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:58.731070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 57/120] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:10:58.736392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c28c9-ef08-4105-8cd0-4114a8529ebb None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:58.751773 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec525161-3143-45f7-b907-58a82f343139 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:58.786537 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af229c98-5e94-4a93-a665-9b56af2ad26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:58.787293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229c98-5e94-4a93-a665-9b56af2ad26d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:58.787588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229c98-5e94-4a93-a665-9b56af2ad26d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:58.787877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af229c98-5e94-4a93-a665-9b56af2ad26d None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:58.788659 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af229c98-5e94-4a93-a665-9b56af2ad26d None admin] RBAC: Adding query filter params (name=member) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:58.788976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af229c98-5e94-4a93-a665-9b56af2ad26d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:58.790357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af229c98-5e94-4a93-a665-9b56af2ad26d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:58.796232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:58.804767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 64/121] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:58.804767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32322-0d28-4cee-89db-5ca72a660395 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:58.804767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32322-0d28-4cee-89db-5ca72a660395 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:58.804767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32322-0d28-4cee-89db-5ca72a660395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:58.818705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-3da32322-0d28-4cee-89db-5ca72a660395 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:10:58.819909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3da32322-0d28-4cee-89db-5ca72a660395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:10:58.849123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c28c9-ef08-4105-8cd0-4114a8529ebb None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:58.873357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:58.891327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf94ef-19a3-4dd5-b585-c417a8023c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:58.892325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf94ef-19a3-4dd5-b585-c417a8023c9b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:58.892681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf94ef-19a3-4dd5-b585-c417a8023c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:58.900386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 65/122] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:10:58.900525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf94ef-19a3-4dd5-b585-c417a8023c9b None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:58.900635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da32322-0d28-4cee-89db-5ca72a660395 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:58.902244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf94ef-19a3-4dd5-b585-c417a8023c9b None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:58.905883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf94ef-19a3-4dd5-b585-c417a8023c9b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:58.905883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 58/123] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:10:58 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:58.905883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf94ef-19a3-4dd5-b585-c417a8023c9b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:59.010073 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da32322-0d28-4cee-89db-5ca72a660395 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:59.011820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf94ef-19a3-4dd5-b585-c417a8023c9b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:59.041480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:59.051259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1014a8d-d649-4e06-98f6-4b5c07b6377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:59.051826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4fa1b-1fdb-4848-81d1-48f776dffda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:59.052396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1014a8d-d649-4e06-98f6-4b5c07b6377e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:59.052750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1014a8d-d649-4e06-98f6-4b5c07b6377e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:59.052838 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4fa1b-1fdb-4848-81d1-48f776dffda7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:59.053088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4fa1b-1fdb-4848-81d1-48f776dffda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:59.053186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1014a8d-d649-4e06-98f6-4b5c07b6377e None admin] PATH_INFO: `/v3/users/7c97d5b600dd47ebad51152c916a100a` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:59.053364 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4fa1b-1fdb-4848-81d1-48f776dffda7 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:59.054412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1014a8d-d649-4e06-98f6-4b5c07b6377e None admin] RBAC: Authorizing `identity:get_user(user_id=7c97d5b600dd47ebad51152c916a100a)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:59.054547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4fa1b-1fdb-4848-81d1-48f776dffda7 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:59.055997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4fa1b-1fdb-4848-81d1-48f776dffda7 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:59.056099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1014a8d-d649-4e06-98f6-4b5c07b6377e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:59.058083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 59/124] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:10:58 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:59.058180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 66/125] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:58 2022] GET /identity/v3/users/7c97d5b600dd47ebad51152c916a100a => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:59.062815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1014a8d-d649-4e06-98f6-4b5c07b6377e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:59.063319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4fa1b-1fdb-4848-81d1-48f776dffda7 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:59.121606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:59.168573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1014a8d-d649-4e06-98f6-4b5c07b6377e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:59.170958 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4fa1b-1fdb-4848-81d1-48f776dffda7 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:59.205982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd4ffd-b01a-44a6-bb0d-affafb8ae3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:59.206710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da81b7-30f5-429c-a669-cfc09dde804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:59.207052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd4ffd-b01a-44a6-bb0d-affafb8ae3ce None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:59.207395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd4ffd-b01a-44a6-bb0d-affafb8ae3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:59.207599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da81b7-30f5-429c-a669-cfc09dde804f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:59.207698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd4ffd-b01a-44a6-bb0d-affafb8ae3ce None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/users/addbdf471d3c4b1db21e1d0d4799f29b/roles/bad10ed55f6140b882d1fdd6994f1fa8` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:59.207886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da81b7-30f5-429c-a669-cfc09dde804f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:59.208279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da81b7-30f5-429c-a669-cfc09dde804f None admin] PATH_INFO: `/v3/users/addbdf471d3c4b1db21e1d0d4799f29b` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:59.210204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da81b7-30f5-429c-a669-cfc09dde804f None admin] RBAC: Authorizing `identity:get_user(user_id=addbdf471d3c4b1db21e1d0d4799f29b)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:59.210765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd4ffd-b01a-44a6-bb0d-affafb8ae3ce None admin] RBAC: Authorizing `identity:create_grant(project_id=32f7396beaa9432bb7fd8ab77c3dfd90, user_id=addbdf471d3c4b1db21e1d0d4799f29b, role_id=bad10ed55f6140b882d1fdd6994f1fa8)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:59.211679 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da81b7-30f5-429c-a669-cfc09dde804f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:59.212340 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd4ffd-b01a-44a6-bb0d-affafb8ae3ce None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:59.218093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 60/126] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:59 2022] GET /identity/v3/users/addbdf471d3c4b1db21e1d0d4799f29b => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:59.218093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da81b7-30f5-429c-a669-cfc09dde804f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:59.231365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 67/127] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:10:59 2022] PUT /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/users/addbdf471d3c4b1db21e1d0d4799f29b/roles/bad10ed55f6140b882d1fdd6994f1fa8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:10:59.232239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd4ffd-b01a-44a6-bb0d-affafb8ae3ce None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:59.292960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:59.341111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da81b7-30f5-429c-a669-cfc09dde804f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:59.354500 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd4ffd-b01a-44a6-bb0d-affafb8ae3ce None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:59.371254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:59.388069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352af599-c7a6-45bd-9868-b1aec5b9becc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:59.389239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352af599-c7a6-45bd-9868-b1aec5b9becc None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:59.389778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352af599-c7a6-45bd-9868-b1aec5b9becc None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:59.390406 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352af599-c7a6-45bd-9868-b1aec5b9becc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:59.395371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc4e3f-1569-4694-a6d6-a2c025133a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:59.396335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4e3f-1569-4694-a6d6-a2c025133a06 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:59.396623 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4e3f-1569-4694-a6d6-a2c025133a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:59.396904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc4e3f-1569-4694-a6d6-a2c025133a06 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:59.398143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc4e3f-1569-4694-a6d6-a2c025133a06 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:59.399923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc4e3f-1569-4694-a6d6-a2c025133a06 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:59.402794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 68/128] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:10:59 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:59.403588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc4e3f-1569-4694-a6d6-a2c025133a06 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:59.404984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352af599-c7a6-45bd-9868-b1aec5b9becc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-352af599-c7a6-45bd-9868-b1aec5b9becc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:10:59.417941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:10:59.418874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:10:59.419651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:10:59.421848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 61/129] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:10:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:10:59.422544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352af599-c7a6-45bd-9868-b1aec5b9becc None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:59.517264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc4e3f-1569-4694-a6d6-a2c025133a06 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:59.553307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352af599-c7a6-45bd-9868-b1aec5b9becc None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:59.554588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de049c-deeb-40c0-9cd4-a5c606982b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:59.555256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de049c-deeb-40c0-9cd4-a5c606982b64 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:59.555544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de049c-deeb-40c0-9cd4-a5c606982b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:59.556103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de049c-deeb-40c0-9cd4-a5c606982b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:59.557857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de049c-deeb-40c0-9cd4-a5c606982b64 None admin] RBAC: Adding query filter params (role.id=725793cd452f4a0b9bcacc1754592b62, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90, user.id=9c10ad892c5b42dda230c4a3f76a6f6d) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:59.558196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de049c-deeb-40c0-9cd4-a5c606982b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:59.559681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de049c-deeb-40c0-9cd4-a5c606982b64 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:59.576410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 69/130] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:10:59 2022] GET /identity/v3/role_assignments?user.id=9c10ad892c5b42dda230c4a3f76a6f6d&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=725793cd452f4a0b9bcacc1754592b62 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:59.577394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de049c-deeb-40c0-9cd4-a5c606982b64 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:59.586732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:59.611412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48d42f-b2e0-4282-a1a5-6f63e140f930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:59.616555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48d42f-b2e0-4282-a1a5-6f63e140f930 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:59.618118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48d42f-b2e0-4282-a1a5-6f63e140f930 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:59.619522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48d42f-b2e0-4282-a1a5-6f63e140f930 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:59.621255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48d42f-b2e0-4282-a1a5-6f63e140f930 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:59.626357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48d42f-b2e0-4282-a1a5-6f63e140f930 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:59.631397 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 62/131] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:10:59 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:59.633245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48d42f-b2e0-4282-a1a5-6f63e140f930 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:59.701823 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:10:59.796984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48d42f-b2e0-4282-a1a5-6f63e140f930 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:59.868223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae76ab-f1ee-4269-b69d-9b3793e9fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:59.868223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae76ab-f1ee-4269-b69d-9b3793e9fe77 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:59.868223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae76ab-f1ee-4269-b69d-9b3793e9fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:59.868223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae76ab-f1ee-4269-b69d-9b3793e9fe77 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:59.868622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae76ab-f1ee-4269-b69d-9b3793e9fe77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:10:59.868622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae76ab-f1ee-4269-b69d-9b3793e9fe77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:59.868622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae76ab-f1ee-4269-b69d-9b3793e9fe77 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:59.870205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de049c-deeb-40c0-9cd4-a5c606982b64 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:10:59.891079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 63/132] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:10:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:10:59.896536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae76ab-f1ee-4269-b69d-9b3793e9fe77 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:59.939281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4d38b-ab27-48a0-a03b-2eca1d05ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:10:59.940323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4d38b-ab27-48a0-a03b-2eca1d05ef13 None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:10:59.940614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4d38b-ab27-48a0-a03b-2eca1d05ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:10:59.940902 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4d38b-ab27-48a0-a03b-2eca1d05ef13 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/users/7c97d5b600dd47ebad51152c916a100a/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:10:59.944116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4d38b-ab27-48a0-a03b-2eca1d05ef13 None admin] RBAC: Authorizing `identity:create_grant(project_id=32f7396beaa9432bb7fd8ab77c3dfd90, user_id=7c97d5b600dd47ebad51152c916a100a, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:10:59.946339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4d38b-ab27-48a0-a03b-2eca1d05ef13 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:10:59.964755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 70/133] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:10:59 2022] PUT /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/users/7c97d5b600dd47ebad51152c916a100a/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:10:59.966215 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4d38b-ab27-48a0-a03b-2eca1d05ef13 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:10:59.992355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:00.122799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae76ab-f1ee-4269-b69d-9b3793e9fe77 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:00.181319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4d38b-ab27-48a0-a03b-2eca1d05ef13 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:00.194210 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9c8f2-4de9-4f1c-bb1b-01f9aea30210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:00.195635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9c8f2-4de9-4f1c-bb1b-01f9aea30210 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:00.196161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9c8f2-4de9-4f1c-bb1b-01f9aea30210 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:00.197002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9c8f2-4de9-4f1c-bb1b-01f9aea30210 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/users/addbdf471d3c4b1db21e1d0d4799f29b/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:00.197124 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:00.199379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9c8f2-4de9-4f1c-bb1b-01f9aea30210 None admin] RBAC: Authorizing `identity:create_grant(project_id=32f7396beaa9432bb7fd8ab77c3dfd90, user_id=addbdf471d3c4b1db21e1d0d4799f29b, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:00.201447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9c8f2-4de9-4f1c-bb1b-01f9aea30210 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:00.224834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 64/134] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:10:59 2022] PUT /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/users/addbdf471d3c4b1db21e1d0d4799f29b/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:00.226475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d227a5-471b-4207-a99e-7a0e057bb6ea None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:00.226993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d227a5-471b-4207-a99e-7a0e057bb6ea None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:00.228552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d227a5-471b-4207-a99e-7a0e057bb6ea None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:00.231596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 65/135] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:00.237376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6ed7b-b8cb-48b5-b9c1-613023efab27 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:00.237997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6ed7b-b8cb-48b5-b9c1-613023efab27 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:00.238496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6ed7b-b8cb-48b5-b9c1-613023efab27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:00.248755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683f543-0c4e-41c5-b6ef-5a77706f6ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:00.249662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683f543-0c4e-41c5-b6ef-5a77706f6ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:00.249949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683f543-0c4e-41c5-b6ef-5a77706f6ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:00.250229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683f543-0c4e-41c5-b6ef-5a77706f6ea0 None admin] PATH_INFO: `/v3/users/addbdf471d3c4b1db21e1d0d4799f29b` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:00.251526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683f543-0c4e-41c5-b6ef-5a77706f6ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=addbdf471d3c4b1db21e1d0d4799f29b)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:00.253060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683f543-0c4e-41c5-b6ef-5a77706f6ea0 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:00.255092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 71/136] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:10:59 2022] GET /identity/v3/users/addbdf471d3c4b1db21e1d0d4799f29b => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:00.259138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-23c6ed7b-b8cb-48b5-b9c1-613023efab27 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:00.260463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683f543-0c4e-41c5-b6ef-5a77706f6ea0 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:00.260979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-23c6ed7b-b8cb-48b5-b9c1-613023efab27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:00.376613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 66/137] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:00.417711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6ed7b-b8cb-48b5-b9c1-613023efab27 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:00.489651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683f543-0c4e-41c5-b6ef-5a77706f6ea0 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:00.501162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:00.574108 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d854-f143-456b-a73d-04617ef967d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:00.575009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d854-f143-456b-a73d-04617ef967d2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:00.575298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d854-f143-456b-a73d-04617ef967d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:00.575580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d854-f143-456b-a73d-04617ef967d2 None admin] PATH_INFO: `/v3/projects/d67b664a43f046f5921366bfc5ed2325` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:00.580820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d854-f143-456b-a73d-04617ef967d2 None admin] RBAC: Authorizing `identity:get_project(project_id=d67b664a43f046f5921366bfc5ed2325)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:00.582319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d854-f143-456b-a73d-04617ef967d2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:00.584173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 72/138] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:00 2022] GET /identity/v3/projects/d67b664a43f046f5921366bfc5ed2325 => generated 312 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:00.585006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6ed7b-b8cb-48b5-b9c1-613023efab27 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:00.589988 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d854-f143-456b-a73d-04617ef967d2 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:00.648792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d72ec-cf83-4f00-83c6-7fc0c13ddf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:00.649615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d72ec-cf83-4f00-83c6-7fc0c13ddf18 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:00.649906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d72ec-cf83-4f00-83c6-7fc0c13ddf18 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:00.650187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d72ec-cf83-4f00-83c6-7fc0c13ddf18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:00.656730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d72ec-cf83-4f00-83c6-7fc0c13ddf18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:00.657695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:00.658592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d72ec-cf83-4f00-83c6-7fc0c13ddf18 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:00.660739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 67/139] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:00.667892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d72ec-cf83-4f00-83c6-7fc0c13ddf18 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:00.726597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d854-f143-456b-a73d-04617ef967d2 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:00.765226 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f276ed-fb25-42fd-8bbf-bd846e8894ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:00.766147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f276ed-fb25-42fd-8bbf-bd846e8894ea None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:00.766530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f276ed-fb25-42fd-8bbf-bd846e8894ea None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:00.766906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f276ed-fb25-42fd-8bbf-bd846e8894ea None admin] PATH_INFO: `/v3/projects/d67b664a43f046f5921366bfc5ed2325/users/addbdf471d3c4b1db21e1d0d4799f29b/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:00.769304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f276ed-fb25-42fd-8bbf-bd846e8894ea None admin] RBAC: Authorizing `identity:create_grant(project_id=d67b664a43f046f5921366bfc5ed2325, user_id=addbdf471d3c4b1db21e1d0d4799f29b, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:00.770928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f276ed-fb25-42fd-8bbf-bd846e8894ea None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:00.776823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d72ec-cf83-4f00-83c6-7fc0c13ddf18 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:00.788642 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 73/140] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:11:00 2022] PUT /identity/v3/projects/d67b664a43f046f5921366bfc5ed2325/users/addbdf471d3c4b1db21e1d0d4799f29b/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:11:00.789646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:00.820914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d364d2-c2d1-4f21-94ba-e2a40c87f060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:00.821690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d364d2-c2d1-4f21-94ba-e2a40c87f060 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:00.822048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d364d2-c2d1-4f21-94ba-e2a40c87f060 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:00.822399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d364d2-c2d1-4f21-94ba-e2a40c87f060 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:00.823239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d364d2-c2d1-4f21-94ba-e2a40c87f060 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:00.824938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d364d2-c2d1-4f21-94ba-e2a40c87f060 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:00.855113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 68/141] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:11:00 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:11:02.158338 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b7dd-4842-4f8c-b28b-18fd7e6e2ba6 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:02.158852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b7dd-4842-4f8c-b28b-18fd7e6e2ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:02.158934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b7dd-4842-4f8c-b28b-18fd7e6e2ba6 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:02.160308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 74/142] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:02.166241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfc844-65c4-4063-9b74-a6fe41a5e4ee None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:02.166390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3a43c-7248-40fa-9e49-49313eb1d4ed None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:02.166767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfc844-65c4-4063-9b74-a6fe41a5e4ee None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:02.166844 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3a43c-7248-40fa-9e49-49313eb1d4ed None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:02.166915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfc844-65c4-4063-9b74-a6fe41a5e4ee None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:02.166986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3a43c-7248-40fa-9e49-49313eb1d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:02.168294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 75/143] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:02.190899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-aee3a43c-7248-40fa-9e49-49313eb1d4ed None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:02.192135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-aee3a43c-7248-40fa-9e49-49313eb1d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:02.206460 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822598f-07d6-4c0d-9cdd-53779e55509a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:02.206866 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822598f-07d6-4c0d-9cdd-53779e55509a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:02.207288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822598f-07d6-4c0d-9cdd-53779e55509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:02.242658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-a822598f-07d6-4c0d-9cdd-53779e55509a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:02.243878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a822598f-07d6-4c0d-9cdd-53779e55509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:02.292505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 69/144] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:02.338290 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3a43c-7248-40fa-9e49-49313eb1d4ed None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:02.365263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 76/145] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:02.476726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:02.484053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3a43c-7248-40fa-9e49-49313eb1d4ed None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:02.524128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822598f-07d6-4c0d-9cdd-53779e55509a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:02.528193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d5388-63e6-46ce-a8de-ac90b8362e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:02.529001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d5388-63e6-46ce-a8de-ac90b8362e8c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:02.529287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d5388-63e6-46ce-a8de-ac90b8362e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:02.529566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d5388-63e6-46ce-a8de-ac90b8362e8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:02.542768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d5388-63e6-46ce-a8de-ac90b8362e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-1b0d5388-63e6-46ce-a8de-ac90b8362e8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:02.550505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:02.551412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:02.552868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 70/146] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:02.558087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d5388-63e6-46ce-a8de-ac90b8362e8c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:02.609319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:02.693670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d5388-63e6-46ce-a8de-ac90b8362e8c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:02.742137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5a18-9bfe-4ef0-965c-d5cd9308f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:02.742835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5a18-9bfe-4ef0-965c-d5cd9308f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:02.743115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5a18-9bfe-4ef0-965c-d5cd9308f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:02.743404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5a18-9bfe-4ef0-965c-d5cd9308f3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:02.744204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5a18-9bfe-4ef0-965c-d5cd9308f3b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:02.744519 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5a18-9bfe-4ef0-965c-d5cd9308f3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:02.746254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5a18-9bfe-4ef0-965c-d5cd9308f3b6 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:02.754829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 71/147] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:02.765019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5a18-9bfe-4ef0-965c-d5cd9308f3b6 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:02.785676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:02.810280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822598f-07d6-4c0d-9cdd-53779e55509a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:02.889763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5a18-9bfe-4ef0-965c-d5cd9308f3b6 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:02.926673 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827eb5-5388-4f3e-9e5a-78213e015ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:02.927633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827eb5-5388-4f3e-9e5a-78213e015ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:02.927925 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827eb5-5388-4f3e-9e5a-78213e015ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:02.928233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827eb5-5388-4f3e-9e5a-78213e015ab1 None admin] PATH_INFO: `/v3/users/9c10ad892c5b42dda230c4a3f76a6f6d` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:02.928684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87181dcf-8b5e-4c72-9862-7d0a93649679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:02.929459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b827eb5-5388-4f3e-9e5a-78213e015ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=9c10ad892c5b42dda230c4a3f76a6f6d)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:02.929570 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87181dcf-8b5e-4c72-9862-7d0a93649679 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:02.929797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87181dcf-8b5e-4c72-9862-7d0a93649679 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:02.930085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87181dcf-8b5e-4c72-9862-7d0a93649679 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:02.931058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b827eb5-5388-4f3e-9e5a-78213e015ab1 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:02.932735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 72/148] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:02 2022] GET /identity/v3/users/9c10ad892c5b42dda230c4a3f76a6f6d => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:02.938107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827eb5-5388-4f3e-9e5a-78213e015ab1 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:02.964605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87181dcf-8b5e-4c72-9862-7d0a93649679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-87181dcf-8b5e-4c72-9862-7d0a93649679 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:02.973238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:02.974647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:02.975408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 77/149] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:11:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:11:02.980899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87181dcf-8b5e-4c72-9862-7d0a93649679 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:03.032345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:03.046227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827eb5-5388-4f3e-9e5a-78213e015ab1 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:03.113424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b1386-d444-4217-86e5-392b52a64f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:03.114317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b1386-d444-4217-86e5-392b52a64f08 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:03.114603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b1386-d444-4217-86e5-392b52a64f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:03.115405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b1386-d444-4217-86e5-392b52a64f08 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:03.116665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b1386-d444-4217-86e5-392b52a64f08 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:03.118127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b1386-d444-4217-86e5-392b52a64f08 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:03.119840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 73/150] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:02 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:03.128546 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b1386-d444-4217-86e5-392b52a64f08 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:03.160314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:03.170844 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87181dcf-8b5e-4c72-9862-7d0a93649679 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:03.209127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dcc30-263f-4d62-8997-eb28feaa17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:03.209804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dcc30-263f-4d62-8997-eb28feaa17b3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:03.210090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dcc30-263f-4d62-8997-eb28feaa17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:03.210366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dcc30-263f-4d62-8997-eb28feaa17b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:03.211127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38dcc30-263f-4d62-8997-eb28feaa17b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:03.211433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38dcc30-263f-4d62-8997-eb28feaa17b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:03.212843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38dcc30-263f-4d62-8997-eb28feaa17b3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:03.222726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 78/151] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:03.228581 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dcc30-263f-4d62-8997-eb28feaa17b3 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:03.353524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dcc30-263f-4d62-8997-eb28feaa17b3 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:03.400888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7fca1-bafd-4bfe-bd78-f7aa076b2eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:03.401699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7fca1-bafd-4bfe-bd78-f7aa076b2eeb None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:03.401985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7fca1-bafd-4bfe-bd78-f7aa076b2eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:03.402263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7fca1-bafd-4bfe-bd78-f7aa076b2eeb None admin] PATH_INFO: `/v3/users/addbdf471d3c4b1db21e1d0d4799f29b` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:03.403481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7fca1-bafd-4bfe-bd78-f7aa076b2eeb None admin] RBAC: Authorizing `identity:get_user(user_id=addbdf471d3c4b1db21e1d0d4799f29b)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:03.407751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7fca1-bafd-4bfe-bd78-f7aa076b2eeb None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:03.410221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 79/152] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:03 2022] GET /identity/v3/users/addbdf471d3c4b1db21e1d0d4799f29b => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:03.416237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7fca1-bafd-4bfe-bd78-f7aa076b2eeb None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:03.460324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:03.489104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b1386-d444-4217-86e5-392b52a64f08 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:03.555293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdc873-8ec2-4b47-bdf9-fe2830eb34e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:03.556219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc873-8ec2-4b47-bdf9-fe2830eb34e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:03.556510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc873-8ec2-4b47-bdf9-fe2830eb34e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:03.556790 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc873-8ec2-4b47-bdf9-fe2830eb34e8 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/users/9c10ad892c5b42dda230c4a3f76a6f6d/roles/725793cd452f4a0b9bcacc1754592b62` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:03.561031 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdc873-8ec2-4b47-bdf9-fe2830eb34e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=32f7396beaa9432bb7fd8ab77c3dfd90, user_id=9c10ad892c5b42dda230c4a3f76a6f6d, role_id=725793cd452f4a0b9bcacc1754592b62)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:03.562501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdc873-8ec2-4b47-bdf9-fe2830eb34e8 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:03.594682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 74/153] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:11:03 2022] PUT /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/users/9c10ad892c5b42dda230c4a3f76a6f6d/roles/725793cd452f4a0b9bcacc1754592b62 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:03.596425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077cff7-2358-4e3d-ae5b-21d45e2e830d None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:03.596738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077cff7-2358-4e3d-ae5b-21d45e2e830d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:03.597025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077cff7-2358-4e3d-ae5b-21d45e2e830d None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:03.598385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 75/154] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:03.605161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b677f1-9fc7-4e5b-a73a-3d6c4ee03453 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:03.605469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b677f1-9fc7-4e5b-a73a-3d6c4ee03453 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:03.605735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b677f1-9fc7-4e5b-a73a-3d6c4ee03453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:03.609013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7fca1-bafd-4bfe-bd78-f7aa076b2eeb None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:03.637131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e1b677f1-9fc7-4e5b-a73a-3d6c4ee03453 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:03.638387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e1b677f1-9fc7-4e5b-a73a-3d6c4ee03453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:03.652766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:03.703848 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc67311-fbec-4e14-9e80-8a0b50182ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:03.704553 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67311-fbec-4e14-9e80-8a0b50182ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:03.704836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67311-fbec-4e14-9e80-8a0b50182ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:03.705115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67311-fbec-4e14-9e80-8a0b50182ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:03.750967 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 76/155] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:03.801354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b677f1-9fc7-4e5b-a73a-3d6c4ee03453 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:03.855738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc67311-fbec-4e14-9e80-8a0b50182ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:03.857247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc67311-fbec-4e14-9e80-8a0b50182ab5 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:03.910752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:04.044013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b677f1-9fc7-4e5b-a73a-3d6c4ee03453 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:04.096718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 80/156] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:11:04.098207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e4072-4711-4a46-9689-1b2437713ea8 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:04.098502 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e4072-4711-4a46-9689-1b2437713ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:04.098783 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e4072-4711-4a46-9689-1b2437713ea8 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:04.099627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b416-38d8-4cd7-9ab2-ece24e6bc1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:04.100126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 81/157] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:04.100679 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b416-38d8-4cd7-9ab2-ece24e6bc1ff None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:04.100964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b416-38d8-4cd7-9ab2-ece24e6bc1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:04.101368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b416-38d8-4cd7-9ab2-ece24e6bc1ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:04.107204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434748-6ba1-40c6-be8d-16239e30ad4a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:04.107499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434748-6ba1-40c6-be8d-16239e30ad4a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:04.107785 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9434748-6ba1-40c6-be8d-16239e30ad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:04.117165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09b416-38d8-4cd7-9ab2-ece24e6bc1ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-6d09b416-38d8-4cd7-9ab2-ece24e6bc1ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:04.126101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:04.127247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:04.128233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:04.131092 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 77/158] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:04.132105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b416-38d8-4cd7-9ab2-ece24e6bc1ff None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:04.136962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-c9434748-6ba1-40c6-be8d-16239e30ad4a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:04.137432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:04.138166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c9434748-6ba1-40c6-be8d-16239e30ad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:04.244677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b416-38d8-4cd7-9ab2-ece24e6bc1ff None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:04.309492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87c591-02f9-4ac9-b14b-127bf3eb3be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:04.310700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87c591-02f9-4ac9-b14b-127bf3eb3be1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:04.311142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87c591-02f9-4ac9-b14b-127bf3eb3be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:04.311568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87c591-02f9-4ac9-b14b-127bf3eb3be1 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:04.313062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87c591-02f9-4ac9-b14b-127bf3eb3be1 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:04.314891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87c591-02f9-4ac9-b14b-127bf3eb3be1 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:04.321506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 78/159] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:04 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:04.322597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87c591-02f9-4ac9-b14b-127bf3eb3be1 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:04.366172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 82/160] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:04.366958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9434748-6ba1-40c6-be8d-16239e30ad4a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:04.442687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:04.476795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:04.500179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87c591-02f9-4ac9-b14b-127bf3eb3be1 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:04.581015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab85fa7-de68-4ecf-a90d-d0cc63fdf6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:04.581508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab85fa7-de68-4ecf-a90d-d0cc63fdf6ca None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:04.581804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab85fa7-de68-4ecf-a90d-d0cc63fdf6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:04.582074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab85fa7-de68-4ecf-a90d-d0cc63fdf6ca None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:04.582842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab85fa7-de68-4ecf-a90d-d0cc63fdf6ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:04.583156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab85fa7-de68-4ecf-a90d-d0cc63fdf6ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:04.585128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab85fa7-de68-4ecf-a90d-d0cc63fdf6ca None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:04.595218 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 79/161] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:04.596097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab85fa7-de68-4ecf-a90d-d0cc63fdf6ca None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:04.600253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9434748-6ba1-40c6-be8d-16239e30ad4a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:04.721245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b2544-1526-487f-8cd3-5ba6a2ef63ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:04.728881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2544-1526-487f-8cd3-5ba6a2ef63ce None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:04.729178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2544-1526-487f-8cd3-5ba6a2ef63ce None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:04.729460 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b2544-1526-487f-8cd3-5ba6a2ef63ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:04.730318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b2544-1526-487f-8cd3-5ba6a2ef63ce None admin] RBAC: Adding query filter params (role.id=bad10ed55f6140b882d1fdd6994f1fa8, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90, user.id=addbdf471d3c4b1db21e1d0d4799f29b) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:04.730635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b2544-1526-487f-8cd3-5ba6a2ef63ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:04.732135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b2544-1526-487f-8cd3-5ba6a2ef63ce None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:04.743061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 83/162] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:04 2022] GET /identity/v3/role_assignments?user.id=addbdf471d3c4b1db21e1d0d4799f29b&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=bad10ed55f6140b882d1fdd6994f1fa8 => generated 608 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:04.743876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b2544-1526-487f-8cd3-5ba6a2ef63ce None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:04.759396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab85fa7-de68-4ecf-a90d-d0cc63fdf6ca None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:04.816825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c54f3-ed29-43e6-80ec-e8fe2b45ef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:04.817669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c54f3-ed29-43e6-80ec-e8fe2b45ef86 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:04.818001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c54f3-ed29-43e6-80ec-e8fe2b45ef86 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:04.818372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c54f3-ed29-43e6-80ec-e8fe2b45ef86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:04.820561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:04.835019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c54f3-ed29-43e6-80ec-e8fe2b45ef86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-0b9c54f3-ed29-43e6-80ec-e8fe2b45ef86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:04.852161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:04.853111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:04.853894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 80/163] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:04.859232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c54f3-ed29-43e6-80ec-e8fe2b45ef86 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:04.984478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c54f3-ed29-43e6-80ec-e8fe2b45ef86 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:05.044767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c24b0-8cdf-4a46-bb19-2011f70eca4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:05.045593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c24b0-8cdf-4a46-bb19-2011f70eca4f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:05.045886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c24b0-8cdf-4a46-bb19-2011f70eca4f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:05.046172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c24b0-8cdf-4a46-bb19-2011f70eca4f None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:05.046953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c24b0-8cdf-4a46-bb19-2011f70eca4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:05.047271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c24b0-8cdf-4a46-bb19-2011f70eca4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:05.048558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b2544-1526-487f-8cd3-5ba6a2ef63ce None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:05.048737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c24b0-8cdf-4a46-bb19-2011f70eca4f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:05.058237 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 81/164] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:05.059597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f04e0b-35f1-4317-a001-769671ac3c4f None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:05.059899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f04e0b-35f1-4317-a001-769671ac3c4f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:05.064499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f04e0b-35f1-4317-a001-769671ac3c4f None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:05.066008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 82/165] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:05.069919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f04e0b-35f1-4317-a001-769671ac3c4f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:05.090216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:05.141804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff73bf-3451-49a4-a4ef-aa23b85be7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:05.142697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff73bf-3451-49a4-a4ef-aa23b85be7ba None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:05.142981 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff73bf-3451-49a4-a4ef-aa23b85be7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:05.143256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff73bf-3451-49a4-a4ef-aa23b85be7ba None admin] PATH_INFO: `/v3/users/addbdf471d3c4b1db21e1d0d4799f29b` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:05.148713 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff73bf-3451-49a4-a4ef-aa23b85be7ba None admin] RBAC: Authorizing `identity:get_user(user_id=addbdf471d3c4b1db21e1d0d4799f29b)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:05.150183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff73bf-3451-49a4-a4ef-aa23b85be7ba None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:05.152018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 84/166] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:04 2022] GET /identity/v3/users/addbdf471d3c4b1db21e1d0d4799f29b => generated 275 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:05.153229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdf2be-dc27-4bc7-a9c3-e0aced442135 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:05.153517 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdf2be-dc27-4bc7-a9c3-e0aced442135 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:05.153791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdf2be-dc27-4bc7-a9c3-e0aced442135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:05.158301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:05.193033 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-b8cdf2be-dc27-4bc7-a9c3-e0aced442135 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:05.194224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b8cdf2be-dc27-4bc7-a9c3-e0aced442135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:05.209168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f04e0b-35f1-4317-a001-769671ac3c4f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:05.247691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d241-4722-47a7-8f38-9a15d2ce9f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:05.248662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d241-4722-47a7-8f38-9a15d2ce9f4e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:05.248950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d241-4722-47a7-8f38-9a15d2ce9f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:05.249234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d241-4722-47a7-8f38-9a15d2ce9f4e None admin] PATH_INFO: `/v3/users/7c97d5b600dd47ebad51152c916a100a` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:05.250500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7d241-4722-47a7-8f38-9a15d2ce9f4e None admin] RBAC: Authorizing `identity:get_user(user_id=7c97d5b600dd47ebad51152c916a100a)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:05.252037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7d241-4722-47a7-8f38-9a15d2ce9f4e None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:05.253870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 83/167] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:05 2022] GET /identity/v3/users/7c97d5b600dd47ebad51152c916a100a => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:05.254766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d241-4722-47a7-8f38-9a15d2ce9f4e None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:05.360526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 85/168] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:05.361450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdf2be-dc27-4bc7-a9c3-e0aced442135 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:05.391089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d241-4722-47a7-8f38-9a15d2ce9f4e None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:05.437462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:05.469244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a702597-c096-4de8-a60b-3c8a568eb2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:05.469917 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702597-c096-4de8-a60b-3c8a568eb2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:05.470204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702597-c096-4de8-a60b-3c8a568eb2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:05.470484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702597-c096-4de8-a60b-3c8a568eb2c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:05.497679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdf2be-dc27-4bc7-a9c3-e0aced442135 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:05.512345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:05.548954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39167870-e1aa-45ee-a29b-6ba666a1ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:05.549641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39167870-e1aa-45ee-a29b-6ba666a1ea3b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:05.549929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39167870-e1aa-45ee-a29b-6ba666a1ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:05.550210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39167870-e1aa-45ee-a29b-6ba666a1ea3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:05.589809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a702597-c096-4de8-a60b-3c8a568eb2c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:05.591718 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a702597-c096-4de8-a60b-3c8a568eb2c6 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:05.709366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39167870-e1aa-45ee-a29b-6ba666a1ea3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:05.710780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39167870-e1aa-45ee-a29b-6ba666a1ea3b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:05.800331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 84/169] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:05.801205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a702597-c096-4de8-a60b-3c8a568eb2c6 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:05.852846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:05.891340 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 86/170] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:05.892708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafffd46-bbc0-417c-bea1-8f9c184314be None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:05.893004 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafffd46-bbc0-417c-bea1-8f9c184314be None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:05.893287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafffd46-bbc0-417c-bea1-8f9c184314be None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:05.894701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 87/171] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:05.895257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafffd46-bbc0-417c-bea1-8f9c184314be None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:05.925829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:06.005616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a702597-c096-4de8-a60b-3c8a568eb2c6 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:06.070062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae30f9-f491-4413-ae67-ca01a7856e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:06.071214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae30f9-f491-4413-ae67-ca01a7856e8f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.071821 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae30f9-f491-4413-ae67-ca01a7856e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.072283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae30f9-f491-4413-ae67-ca01a7856e8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.084446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafffd46-bbc0-417c-bea1-8f9c184314be None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:06.086095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae30f9-f491-4413-ae67-ca01a7856e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-2bae30f9-f491-4413-ae67-ca01a7856e8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:06.096490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:06.097409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:06.098175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:06.105732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 85/172] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:06.105732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae30f9-f491-4413-ae67-ca01a7856e8f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:06.130020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce508462-5e47-48e7-bdff-1007adb5e708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:06.131731 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce508462-5e47-48e7-bdff-1007adb5e708 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.132249 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce508462-5e47-48e7-bdff-1007adb5e708 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.132736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce508462-5e47-48e7-bdff-1007adb5e708 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.134139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce508462-5e47-48e7-bdff-1007adb5e708 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:06.135776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce508462-5e47-48e7-bdff-1007adb5e708 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:06.137987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 88/173] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:05 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:06.139312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a282b4-83aa-410a-8dda-64e435dfa7c8 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.139809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a282b4-83aa-410a-8dda-64e435dfa7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.140302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a282b4-83aa-410a-8dda-64e435dfa7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.156590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d2a282b4-83aa-410a-8dda-64e435dfa7c8 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:06.158062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d2a282b4-83aa-410a-8dda-64e435dfa7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:06.201264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:06.219612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae30f9-f491-4413-ae67-ca01a7856e8f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:06.228440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 89/174] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:06.230051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c188bb-281f-44fd-a82c-3da4aefd9c3c None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.230543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c188bb-281f-44fd-a82c-3da4aefd9c3c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.231040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c188bb-281f-44fd-a82c-3da4aefd9c3c None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.232524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 90/175] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:06.237185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c188bb-281f-44fd-a82c-3da4aefd9c3c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:06.252746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:06.266122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c023d-74b5-4d58-8122-353eb1580b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:06.266931 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c023d-74b5-4d58-8122-353eb1580b53 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.267211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c023d-74b5-4d58-8122-353eb1580b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.267488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c023d-74b5-4d58-8122-353eb1580b53 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.268713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c023d-74b5-4d58-8122-353eb1580b53 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:06.270511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c023d-74b5-4d58-8122-353eb1580b53 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:06.272243 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 86/176] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:06 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:06.273248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c023d-74b5-4d58-8122-353eb1580b53 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:06.370911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c188bb-281f-44fd-a82c-3da4aefd9c3c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:06.380318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c023d-74b5-4d58-8122-353eb1580b53 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:06.407155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5f813-baf4-4bf8-83d0-9c66da835b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:06.408279 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5f813-baf4-4bf8-83d0-9c66da835b1b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.408792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5f813-baf4-4bf8-83d0-9c66da835b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.409269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5f813-baf4-4bf8-83d0-9c66da835b1b None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.410254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5f813-baf4-4bf8-83d0-9c66da835b1b None admin] RBAC: Adding query filter params (name=member) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:06.410803 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5f813-baf4-4bf8-83d0-9c66da835b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:06.413030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5f813-baf4-4bf8-83d0-9c66da835b1b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:06.419726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043751ff-073d-4cb5-9f92-1cbf20d71413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:06.420287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043751ff-073d-4cb5-9f92-1cbf20d71413 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.420630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043751ff-073d-4cb5-9f92-1cbf20d71413 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.420914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043751ff-073d-4cb5-9f92-1cbf20d71413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.421870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043751ff-073d-4cb5-9f92-1cbf20d71413 None admin] RBAC: Adding query filter params (role.id=531d1ead7d164c708ad131b14d2f9301, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90, user.id=addbdf471d3c4b1db21e1d0d4799f29b) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:06.422198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043751ff-073d-4cb5-9f92-1cbf20d71413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:06.423749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043751ff-073d-4cb5-9f92-1cbf20d71413 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:06.424860 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 91/177] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:06.426369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587642d-f002-4dec-b3d7-f88f2823ffe4 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.426887 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587642d-f002-4dec-b3d7-f88f2823ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.428030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587642d-f002-4dec-b3d7-f88f2823ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.432552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 87/178] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:06 2022] GET /identity/v3/role_assignments?user.id=addbdf471d3c4b1db21e1d0d4799f29b&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:06.433767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043751ff-073d-4cb5-9f92-1cbf20d71413 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:06.447273 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-a587642d-f002-4dec-b3d7-f88f2823ffe4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:06.448934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a587642d-f002-4dec-b3d7-f88f2823ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:06.461773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:06.527582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 92/179] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:06.529224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587642d-f002-4dec-b3d7-f88f2823ffe4 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:06.537935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:06.557251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043751ff-073d-4cb5-9f92-1cbf20d71413 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:06.596643 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcf2b8-381b-412d-82b3-c50999f62605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:06.597809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcf2b8-381b-412d-82b3-c50999f62605 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.598195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcf2b8-381b-412d-82b3-c50999f62605 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.598738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcf2b8-381b-412d-82b3-c50999f62605 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.611185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcf2b8-381b-412d-82b3-c50999f62605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-47fcf2b8-381b-412d-82b3-c50999f62605 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:06.620677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:06.621614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:06.622403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:06.626644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 88/180] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:11:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:06.627632 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcf2b8-381b-412d-82b3-c50999f62605 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:06.660441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587642d-f002-4dec-b3d7-f88f2823ffe4 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:06.707243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4449e7-7f06-4805-87e0-06e66be7be53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:06.709110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4449e7-7f06-4805-87e0-06e66be7be53 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.710092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4449e7-7f06-4805-87e0-06e66be7be53 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.710429 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4449e7-7f06-4805-87e0-06e66be7be53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.711461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4449e7-7f06-4805-87e0-06e66be7be53 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90, user.id=7c97d5b600dd47ebad51152c916a100a) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:06.711820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4449e7-7f06-4805-87e0-06e66be7be53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:06.714210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4449e7-7f06-4805-87e0-06e66be7be53 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:06.720474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:06.722181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 93/181] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:06 2022] GET /identity/v3/role_assignments?user.id=7c97d5b600dd47ebad51152c916a100a&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:06.723467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697da7-8bdd-40a3-bd62-5edfba49332b None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.723754 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697da7-8bdd-40a3-bd62-5edfba49332b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.724088 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25697da7-8bdd-40a3-bd62-5edfba49332b None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.726336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 94/182] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:06.726336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25697da7-8bdd-40a3-bd62-5edfba49332b None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:06.769278 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcf2b8-381b-412d-82b3-c50999f62605 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:06.809770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:06.812211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9264a-1614-4640-ac78-998b3681dec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:06.813315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9264a-1614-4640-ac78-998b3681dec3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.813752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9264a-1614-4640-ac78-998b3681dec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.814175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9264a-1614-4640-ac78-998b3681dec3 None admin] PATH_INFO: `/v3/users/addbdf471d3c4b1db21e1d0d4799f29b` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.815662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9264a-1614-4640-ac78-998b3681dec3 None admin] RBAC: Authorizing `identity:get_user(user_id=addbdf471d3c4b1db21e1d0d4799f29b)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:06.819164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9264a-1614-4640-ac78-998b3681dec3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:06.821177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 89/183] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:06 2022] GET /identity/v3/users/addbdf471d3c4b1db21e1d0d4799f29b => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:06.822225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9264a-1614-4640-ac78-998b3681dec3 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:06.858513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25697da7-8bdd-40a3-bd62-5edfba49332b None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:06.898911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f8229-c3f7-4208-9bf8-026654811456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:06.899797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f8229-c3f7-4208-9bf8-026654811456 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.900133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f8229-c3f7-4208-9bf8-026654811456 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.900415 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f8229-c3f7-4208-9bf8-026654811456 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.912895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f8229-c3f7-4208-9bf8-026654811456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-056f8229-c3f7-4208-9bf8-026654811456 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:06.921182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:06.922084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:06.922875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 95/184] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:11:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:06.924495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e77be-545b-45f7-8c5b-a5fab6fa2d76 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.927999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e77be-545b-45f7-8c5b-a5fab6fa2d76 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.927999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e77be-545b-45f7-8c5b-a5fab6fa2d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.943277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-5b4e77be-545b-45f7-8c5b-a5fab6fa2d76 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:06.944515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5b4e77be-545b-45f7-8c5b-a5fab6fa2d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:06.945217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9264a-1614-4640-ac78-998b3681dec3 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:06.986860 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac7eae-a58a-4300-9b66-9d7a76bd787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:06.987541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7eae-a58a-4300-9b66-9d7a76bd787d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:06.987892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7eae-a58a-4300-9b66-9d7a76bd787d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:06.988167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7eae-a58a-4300-9b66-9d7a76bd787d None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:06.988910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac7eae-a58a-4300-9b66-9d7a76bd787d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:06.989219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac7eae-a58a-4300-9b66-9d7a76bd787d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:06.991139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac7eae-a58a-4300-9b66-9d7a76bd787d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:06.999329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 90/185] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:07.000150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac7eae-a58a-4300-9b66-9d7a76bd787d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:07.009791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:07.026334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 96/186] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:07.027658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92aa7-208f-42d3-b5ec-0246623652e4 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.027949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92aa7-208f-42d3-b5ec-0246623652e4 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.028262 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e92aa7-208f-42d3-b5ec-0246623652e4 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:07.029518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 97/187] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:07.030210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e92aa7-208f-42d3-b5ec-0246623652e4 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:07.089673 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:07.109903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac7eae-a58a-4300-9b66-9d7a76bd787d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:07.132804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e92aa7-208f-42d3-b5ec-0246623652e4 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:07.143715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b73d9-3376-4ed8-8144-32aa4cede8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:07.144389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b73d9-3376-4ed8-8144-32aa4cede8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.144674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b73d9-3376-4ed8-8144-32aa4cede8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.144951 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b73d9-3376-4ed8-8144-32aa4cede8e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:07.165835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41ff0f-4e48-4e38-8466-0408066be19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:07.166501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41ff0f-4e48-4e38-8466-0408066be19f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.166788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41ff0f-4e48-4e38-8466-0408066be19f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.167067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41ff0f-4e48-4e38-8466-0408066be19f None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:07.167816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41ff0f-4e48-4e38-8466-0408066be19f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:07.168165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41ff0f-4e48-4e38-8466-0408066be19f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:07.169574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41ff0f-4e48-4e38-8466-0408066be19f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:07.177944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 98/188] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:07.180833 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41ff0f-4e48-4e38-8466-0408066be19f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:07.211230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b73d9-3376-4ed8-8144-32aa4cede8e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:07.212773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b73d9-3376-4ed8-8144-32aa4cede8e2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:07.220525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:07.277859 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41ff0f-4e48-4e38-8466-0408066be19f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:07.297494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:07.309357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 91/189] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:07.310632 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530049-a3e2-4e9c-aff9-f3074bbb9b76 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.310923 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530049-a3e2-4e9c-aff9-f3074bbb9b76 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.311205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14530049-a3e2-4e9c-aff9-f3074bbb9b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:07.316454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91636453-f81e-4ce8-8674-93dbb79ccb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:07.317321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636453-f81e-4ce8-8674-93dbb79ccb4c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.317604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636453-f81e-4ce8-8674-93dbb79ccb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.318394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636453-f81e-4ce8-8674-93dbb79ccb4c None admin] PATH_INFO: `/v3/users/9bda687ebbd24d7890e540f9ef3aa41c` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:07.328702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-14530049-a3e2-4e9c-aff9-f3074bbb9b76 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:07.329887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-14530049-a3e2-4e9c-aff9-f3074bbb9b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:07.331344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91636453-f81e-4ce8-8674-93dbb79ccb4c None admin] RBAC: Authorizing `identity:get_user(user_id=9bda687ebbd24d7890e540f9ef3aa41c)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:07.332838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91636453-f81e-4ce8-8674-93dbb79ccb4c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:07.335133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 99/190] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:07 2022] GET /identity/v3/users/9bda687ebbd24d7890e540f9ef3aa41c => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:07.339607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91636453-f81e-4ce8-8674-93dbb79ccb4c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:07.394342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 92/191] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:07.395097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14530049-a3e2-4e9c-aff9-f3074bbb9b76 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:07.429299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:07.435072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91636453-f81e-4ce8-8674-93dbb79ccb4c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:07.468958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f54925-27e0-4ff5-bf87-06c86460c9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:07.469740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f54925-27e0-4ff5-bf87-06c86460c9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.470022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f54925-27e0-4ff5-bf87-06c86460c9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.470304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f54925-27e0-4ff5-bf87-06c86460c9d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:07.471453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f54925-27e0-4ff5-bf87-06c86460c9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:07.473016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f54925-27e0-4ff5-bf87-06c86460c9d3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:07.474645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 100/192] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:07.479062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f54925-27e0-4ff5-bf87-06c86460c9d3 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:07.497245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14530049-a3e2-4e9c-aff9-f3074bbb9b76 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:07.520576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:07.530161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447faa5-9b81-4076-9984-7672b9b54252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:07.531026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447faa5-9b81-4076-9984-7672b9b54252 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.531308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447faa5-9b81-4076-9984-7672b9b54252 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.531584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447faa5-9b81-4076-9984-7672b9b54252 None admin] PATH_INFO: `/v3/users/9bda687ebbd24d7890e540f9ef3aa41c` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:07.532810 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447faa5-9b81-4076-9984-7672b9b54252 None admin] RBAC: Authorizing `identity:get_user(user_id=9bda687ebbd24d7890e540f9ef3aa41c)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:07.534251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447faa5-9b81-4076-9984-7672b9b54252 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:07.535877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 93/193] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:07 2022] GET /identity/v3/users/9bda687ebbd24d7890e540f9ef3aa41c => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:07.536693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447faa5-9b81-4076-9984-7672b9b54252 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:07.573925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f54925-27e0-4ff5-bf87-06c86460c9d3 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:07.606296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e539b9-e9ed-4cdb-850f-0378070ca8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:07.607145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e539b9-e9ed-4cdb-850f-0378070ca8bf None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.607428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e539b9-e9ed-4cdb-850f-0378070ca8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.607703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e539b9-e9ed-4cdb-850f-0378070ca8bf None admin] PATH_INFO: `/v3/projects/d67b664a43f046f5921366bfc5ed2325` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:07.608959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e539b9-e9ed-4cdb-850f-0378070ca8bf None admin] RBAC: Authorizing `identity:get_project(project_id=d67b664a43f046f5921366bfc5ed2325)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:07.610409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e539b9-e9ed-4cdb-850f-0378070ca8bf None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:07.612134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 101/194] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:07 2022] GET /identity/v3/projects/d67b664a43f046f5921366bfc5ed2325 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:07.612880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e539b9-e9ed-4cdb-850f-0378070ca8bf None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:07.634560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447faa5-9b81-4076-9984-7672b9b54252 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:07.636811 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:07.668605 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d527ed-ae85-4a6d-a3a0-911ee2ae1ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:07.669179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d527ed-ae85-4a6d-a3a0-911ee2ae1ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.669465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d527ed-ae85-4a6d-a3a0-911ee2ae1ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.669734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d527ed-ae85-4a6d-a3a0-911ee2ae1ec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:07.710563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e539b9-e9ed-4cdb-850f-0378070ca8bf None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:07.724797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:07.735952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d527ed-ae85-4a6d-a3a0-911ee2ae1ec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:07.737447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d527ed-ae85-4a6d-a3a0-911ee2ae1ec0 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:07.744849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3bf94-b3a2-46bd-a2ac-f5ef34acb195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:07.745641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3bf94-b3a2-46bd-a2ac-f5ef34acb195 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.745933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3bf94-b3a2-46bd-a2ac-f5ef34acb195 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.746213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3bf94-b3a2-46bd-a2ac-f5ef34acb195 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:07.755991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3bf94-b3a2-46bd-a2ac-f5ef34acb195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-8ba3bf94-b3a2-46bd-a2ac-f5ef34acb195 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:07.763820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:07.764726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:07.765509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 102/195] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:07.766291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3bf94-b3a2-46bd-a2ac-f5ef34acb195 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:07.839449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 94/196] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:07.840318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d527ed-ae85-4a6d-a3a0-911ee2ae1ec0 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:07.844707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:07.866863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3bf94-b3a2-46bd-a2ac-f5ef34acb195 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:07.900139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add92fb8-872e-4778-b164-f9f165d7a315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:07.900802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add92fb8-872e-4778-b164-f9f165d7a315 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.901083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add92fb8-872e-4778-b164-f9f165d7a315 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.901356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add92fb8-872e-4778-b164-f9f165d7a315 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:07.902062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add92fb8-872e-4778-b164-f9f165d7a315 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:07.903489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add92fb8-872e-4778-b164-f9f165d7a315 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:07.921333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 103/197] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:11:07 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:11:07.922131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add92fb8-872e-4778-b164-f9f165d7a315 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:07.952728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d527ed-ae85-4a6d-a3a0-911ee2ae1ec0 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:07.960776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:07.993440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57858642-f3bf-4176-a8bd-83923c73d9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:07.994177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57858642-f3bf-4176-a8bd-83923c73d9cf None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:07.994469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57858642-f3bf-4176-a8bd-83923c73d9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:07.994752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57858642-f3bf-4176-a8bd-83923c73d9cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:08.044680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add92fb8-872e-4778-b164-f9f165d7a315 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:08.076177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57858642-f3bf-4176-a8bd-83923c73d9cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:08.077660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57858642-f3bf-4176-a8bd-83923c73d9cf None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:08.082672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:08.087553 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bc829-f612-403f-b3d0-2274487ae765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:08.088556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc829-f612-403f-b3d0-2274487ae765 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:08.088852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc829-f612-403f-b3d0-2274487ae765 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:08.089133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bc829-f612-403f-b3d0-2274487ae765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:08.089978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bc829-f612-403f-b3d0-2274487ae765 None admin] RBAC: Adding query filter params (role.id=531d1ead7d164c708ad131b14d2f9301, scope.project.id=d67b664a43f046f5921366bfc5ed2325, user.id=addbdf471d3c4b1db21e1d0d4799f29b) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:08.090321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bc829-f612-403f-b3d0-2274487ae765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:08.092113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bc829-f612-403f-b3d0-2274487ae765 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:08.098421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 104/198] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:07 2022] GET /identity/v3/role_assignments?user.id=addbdf471d3c4b1db21e1d0d4799f29b&scope.project.id=d67b664a43f046f5921366bfc5ed2325&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:08.099249 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bc829-f612-403f-b3d0-2274487ae765 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:08.223125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 95/199] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:08.226493 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57858642-f3bf-4176-a8bd-83923c73d9cf None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:08.253284 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:08.263482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bc829-f612-403f-b3d0-2274487ae765 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:08.310598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b2227-1ecb-4c48-ad9f-d14a43ea0402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:08.311281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2227-1ecb-4c48-ad9f-d14a43ea0402 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:08.311571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2227-1ecb-4c48-ad9f-d14a43ea0402 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:08.311854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2227-1ecb-4c48-ad9f-d14a43ea0402 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:08.313541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b2227-1ecb-4c48-ad9f-d14a43ea0402 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:08.313886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b2227-1ecb-4c48-ad9f-d14a43ea0402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:08.315285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b2227-1ecb-4c48-ad9f-d14a43ea0402 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:08.326490 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 105/200] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:08.327142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b2227-1ecb-4c48-ad9f-d14a43ea0402 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:08.359494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57858642-f3bf-4176-a8bd-83923c73d9cf None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:08.361950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:08.404621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c84cde-af80-4321-96e1-89b9641b669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:08.405736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c84cde-af80-4321-96e1-89b9641b669f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:08.406163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c84cde-af80-4321-96e1-89b9641b669f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:08.406687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c84cde-af80-4321-96e1-89b9641b669f None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:08.408517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c84cde-af80-4321-96e1-89b9641b669f None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:08.410112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c84cde-af80-4321-96e1-89b9641b669f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:08.412564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 96/201] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:08 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:08.416860 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c84cde-af80-4321-96e1-89b9641b669f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:08.461419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b2227-1ecb-4c48-ad9f-d14a43ea0402 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:08.512388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2bbc9-759c-4222-a590-fb20606e1d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:08.513464 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2bbc9-759c-4222-a590-fb20606e1d73 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:08.513755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2bbc9-759c-4222-a590-fb20606e1d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:08.514039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2bbc9-759c-4222-a590-fb20606e1d73 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:08.515992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2bbc9-759c-4222-a590-fb20606e1d73 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:08.518010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2bbc9-759c-4222-a590-fb20606e1d73 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:08.520507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 106/202] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:08 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:08.521886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2bbc9-759c-4222-a590-fb20606e1d73 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:08.536096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c84cde-af80-4321-96e1-89b9641b669f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:08.556379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:08.573512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b511a-ddcf-4915-8f29-8e95329416ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:08.574628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b511a-ddcf-4915-8f29-8e95329416ae None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:08.575046 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b511a-ddcf-4915-8f29-8e95329416ae None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:08.575451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b511a-ddcf-4915-8f29-8e95329416ae None admin] PATH_INFO: `/v3/users/9c10ad892c5b42dda230c4a3f76a6f6d` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:08.577467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b511a-ddcf-4915-8f29-8e95329416ae None admin] RBAC: Authorizing `identity:get_user(user_id=9c10ad892c5b42dda230c4a3f76a6f6d)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:08.579576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b511a-ddcf-4915-8f29-8e95329416ae None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:08.582149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 97/203] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:08 2022] GET /identity/v3/users/9c10ad892c5b42dda230c4a3f76a6f6d => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:08.583147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b511a-ddcf-4915-8f29-8e95329416ae None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:08.642287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:08.642892 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2bbc9-759c-4222-a590-fb20606e1d73 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:08.681477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22e3fb-a6e2-42af-9020-8e539f8f5c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:08.682135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e3fb-a6e2-42af-9020-8e539f8f5c62 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:08.682418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e3fb-a6e2-42af-9020-8e539f8f5c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:08.682694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22e3fb-a6e2-42af-9020-8e539f8f5c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:08.683631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22e3fb-a6e2-42af-9020-8e539f8f5c62 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=75585a6ed1724a4199c43e9f777fe503, user.id=9bda687ebbd24d7890e540f9ef3aa41c) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:08.684011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22e3fb-a6e2-42af-9020-8e539f8f5c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:08.685571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22e3fb-a6e2-42af-9020-8e539f8f5c62 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:08.700172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 107/204] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:08 2022] GET /identity/v3/role_assignments?user.id=9bda687ebbd24d7890e540f9ef3aa41c&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:08.701212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22e3fb-a6e2-42af-9020-8e539f8f5c62 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:08.721717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b511a-ddcf-4915-8f29-8e95329416ae None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:08.766232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525f589-83ca-43ff-ad12-ea74c1f83bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:08.767246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525f589-83ca-43ff-ad12-ea74c1f83bad None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:08.767756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525f589-83ca-43ff-ad12-ea74c1f83bad None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:08.768834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525f589-83ca-43ff-ad12-ea74c1f83bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:08.770117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525f589-83ca-43ff-ad12-ea74c1f83bad None admin] RBAC: Adding query filter params (role.id=bad10ed55f6140b882d1fdd6994f1fa8, scope.project.id=75585a6ed1724a4199c43e9f777fe503, user.id=9bda687ebbd24d7890e540f9ef3aa41c) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:08.770710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525f589-83ca-43ff-ad12-ea74c1f83bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:08.772645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525f589-83ca-43ff-ad12-ea74c1f83bad None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:08.779939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 98/205] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:08 2022] GET /identity/v3/role_assignments?user.id=9bda687ebbd24d7890e540f9ef3aa41c&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=bad10ed55f6140b882d1fdd6994f1fa8 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:08.887010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:08.900602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22e3fb-a6e2-42af-9020-8e539f8f5c62 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:08.940423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81f713-818b-476e-916a-d6092913ff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:08.941098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81f713-818b-476e-916a-d6092913ff85 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:08.941381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81f713-818b-476e-916a-d6092913ff85 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:08.941658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81f713-818b-476e-916a-d6092913ff85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:09.047805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81f713-818b-476e-916a-d6092913ff85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:09.049314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81f713-818b-476e-916a-d6092913ff85 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:09.179455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:09.192021 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 108/206] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:09.197982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525f589-83ca-43ff-ad12-ea74c1f83bad None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:09.306394 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525f589-83ca-43ff-ad12-ea74c1f83bad None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:09.308695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:09.351882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb04f3-2904-4329-ad88-83720ffd1ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:09.352787 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb04f3-2904-4329-ad88-83720ffd1ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:09.353070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb04f3-2904-4329-ad88-83720ffd1ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:09.353350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb04f3-2904-4329-ad88-83720ffd1ea9 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:09.354580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb04f3-2904-4329-ad88-83720ffd1ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:09.356141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb04f3-2904-4329-ad88-83720ffd1ea9 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:09.358089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 99/207] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:09 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:09.363760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81f713-818b-476e-916a-d6092913ff85 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:09.498632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81f713-818b-476e-916a-d6092913ff85 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:09.545597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a50f3-7229-465a-88e1-d7cbe3ee680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:09.546269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a50f3-7229-465a-88e1-d7cbe3ee680a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:09.546550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a50f3-7229-465a-88e1-d7cbe3ee680a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:09.546824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a50f3-7229-465a-88e1-d7cbe3ee680a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:09.547661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a50f3-7229-465a-88e1-d7cbe3ee680a None admin] RBAC: Adding query filter params (role.id=725793cd452f4a0b9bcacc1754592b62, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90, user.id=9c10ad892c5b42dda230c4a3f76a6f6d) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:09.547995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a50f3-7229-465a-88e1-d7cbe3ee680a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:09.549470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a50f3-7229-465a-88e1-d7cbe3ee680a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:09.560443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 109/208] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:09 2022] GET /identity/v3/role_assignments?user.id=9c10ad892c5b42dda230c4a3f76a6f6d&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=725793cd452f4a0b9bcacc1754592b62 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:10.449167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a282a-e0f1-47cf-b4f6-dfea726b13b7 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:10.449676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a282a-e0f1-47cf-b4f6-dfea726b13b7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:10.449750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a282a-e0f1-47cf-b4f6-dfea726b13b7 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:10.451105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 100/209] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:10.456306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33cad-7fc3-4f30-a66a-7edaeef17321 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:10.456717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33cad-7fc3-4f30-a66a-7edaeef17321 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:10.456883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33cad-7fc3-4f30-a66a-7edaeef17321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:10.474678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-f5b33cad-7fc3-4f30-a66a-7edaeef17321 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:10.475854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f5b33cad-7fc3-4f30-a66a-7edaeef17321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:10.525205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:10.547380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 110/210] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:10.570700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a282a-e0f1-47cf-b4f6-dfea726b13b7 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:10.679521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a282a-e0f1-47cf-b4f6-dfea726b13b7 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:10.680742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24ce6-8a77-4995-b03b-41a6db426c09 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:10.681144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24ce6-8a77-4995-b03b-41a6db426c09 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:10.681426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24ce6-8a77-4995-b03b-41a6db426c09 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:10.682919 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 111/211] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:11:10.688170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34167783-7c3d-46b3-be41-e2f296398468 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:10.688458 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34167783-7c3d-46b3-be41-e2f296398468 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:10.689193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34167783-7c3d-46b3-be41-e2f296398468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:10.709816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-34167783-7c3d-46b3-be41-e2f296398468 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:10.711826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-34167783-7c3d-46b3-be41-e2f296398468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:10.715524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a504f1-78df-45bb-9a2c-cf8f123819ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:10.716601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a504f1-78df-45bb-9a2c-cf8f123819ad None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:10.716885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a504f1-78df-45bb-9a2c-cf8f123819ad None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:10.717161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a504f1-78df-45bb-9a2c-cf8f123819ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:10.727907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a504f1-78df-45bb-9a2c-cf8f123819ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-a5a504f1-78df-45bb-9a2c-cf8f123819ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:10.735789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:10.736688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:10.737506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 101/212] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:10.743395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a504f1-78df-45bb-9a2c-cf8f123819ad None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:10.780430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:10.792649 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 112/213] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:10.818280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34167783-7c3d-46b3-be41-e2f296398468 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:10.865856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a504f1-78df-45bb-9a2c-cf8f123819ad None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:10.902260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53984a7c-8893-4ef5-af56-3ae888dc66a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:10.902934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53984a7c-8893-4ef5-af56-3ae888dc66a4 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:10.903221 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53984a7c-8893-4ef5-af56-3ae888dc66a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:10.903501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53984a7c-8893-4ef5-af56-3ae888dc66a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:10.904303 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53984a7c-8893-4ef5-af56-3ae888dc66a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:10.904616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53984a7c-8893-4ef5-af56-3ae888dc66a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:10.906000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53984a7c-8893-4ef5-af56-3ae888dc66a4 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:10.920246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 102/214] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:10.921153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53984a7c-8893-4ef5-af56-3ae888dc66a4 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:10.947815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34167783-7c3d-46b3-be41-e2f296398468 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:10.963600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:10.986855 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073731d-1efd-4165-8464-be4f37001232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:10.987872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073731d-1efd-4165-8464-be4f37001232 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:10.988300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073731d-1efd-4165-8464-be4f37001232 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:10.988678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073731d-1efd-4165-8464-be4f37001232 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:10.990555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073731d-1efd-4165-8464-be4f37001232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:10.992145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073731d-1efd-4165-8464-be4f37001232 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:10.998516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 113/215] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:10.999441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073731d-1efd-4165-8464-be4f37001232 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:11.032385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:11.041696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53984a7c-8893-4ef5-af56-3ae888dc66a4 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:11.091776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23f64c-36f8-44a2-919a-f589b7874261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:11.093088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f64c-36f8-44a2-919a-f589b7874261 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:11.093577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f64c-36f8-44a2-919a-f589b7874261 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:11.094055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23f64c-36f8-44a2-919a-f589b7874261 None admin] PATH_INFO: `/v3/users/7618a60dcea6435780f1536aeed614f6` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:11.109621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23f64c-36f8-44a2-919a-f589b7874261 None admin] RBAC: Authorizing `identity:get_user(user_id=7618a60dcea6435780f1536aeed614f6)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:11.111499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23f64c-36f8-44a2-919a-f589b7874261 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:11.113588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 103/216] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:10 2022] GET /identity/v3/users/7618a60dcea6435780f1536aeed614f6 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:11.115343 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b807fb5-49d1-47cd-94f9-41979e4b1573 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:11.115837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b807fb5-49d1-47cd-94f9-41979e4b1573 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:11.116335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b807fb5-49d1-47cd-94f9-41979e4b1573 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:11.118167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 104/217] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:11.119212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b807fb5-49d1-47cd-94f9-41979e4b1573 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:11.125327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073731d-1efd-4165-8464-be4f37001232 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:11.160389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d57a7-a165-4875-b17b-5dbb607ab34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:11.161066 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d57a7-a165-4875-b17b-5dbb607ab34f None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:11.161882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d57a7-a165-4875-b17b-5dbb607ab34f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:11.162161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d57a7-a165-4875-b17b-5dbb607ab34f None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:11.163286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d57a7-a165-4875-b17b-5dbb607ab34f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:11.165123 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d57a7-a165-4875-b17b-5dbb607ab34f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:11.190131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 114/218] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:11:10 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:11:11.191810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f176fe-751c-4442-aa50-2b75b1c71412 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:11.191944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f176fe-751c-4442-aa50-2b75b1c71412 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:11.192220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f176fe-751c-4442-aa50-2b75b1c71412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:11.210350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-c1f176fe-751c-4442-aa50-2b75b1c71412 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:11.211673 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c1f176fe-751c-4442-aa50-2b75b1c71412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:11.248210 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b807fb5-49d1-47cd-94f9-41979e4b1573 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:11.267759 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:11.300181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a2b94-dd13-43eb-a3cc-e4a8e4c6fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:11.300854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a2b94-dd13-43eb-a3cc-e4a8e4c6fe0b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:11.301138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a2b94-dd13-43eb-a3cc-e4a8e4c6fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:11.301419 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a2b94-dd13-43eb-a3cc-e4a8e4c6fe0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:11.319303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 115/219] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:11.329690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:11.336924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ac58-2bec-45e9-9433-44ccf67f4080 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:11.337233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ac58-2bec-45e9-9433-44ccf67f4080 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:11.337501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ac58-2bec-45e9-9433-44ccf67f4080 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:11.338936 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 116/220] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:11:11.344858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bd0fe-9681-444c-9bd5-49c7420c0dbd None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:11.345166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bd0fe-9681-444c-9bd5-49c7420c0dbd None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:11.345439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bd0fe-9681-444c-9bd5-49c7420c0dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:11.363084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-5c6bd0fe-9681-444c-9bd5-49c7420c0dbd None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:11.364835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5c6bd0fe-9681-444c-9bd5-49c7420c0dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:11.387634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a2b94-dd13-43eb-a3cc-e4a8e4c6fe0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:11.389555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a2b94-dd13-43eb-a3cc-e4a8e4c6fe0b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:11.440391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 117/221] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:11.441252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bd0fe-9681-444c-9bd5-49c7420c0dbd None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:11.510759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 105/222] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:11.511837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a2b94-dd13-43eb-a3cc-e4a8e4c6fe0b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:11.563232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:11.569797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bd0fe-9681-444c-9bd5-49c7420c0dbd None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:11.574712 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:11.608644 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f09d19-2741-4f59-8810-110211e1f59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:11.609684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f09d19-2741-4f59-8810-110211e1f59a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:11.609970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f09d19-2741-4f59-8810-110211e1f59a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:11.610342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f09d19-2741-4f59-8810-110211e1f59a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:11.621714 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f09d19-2741-4f59-8810-110211e1f59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-09f09d19-2741-4f59-8810-110211e1f59a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:11.629616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:11.631240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:11.632243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:11.634134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 118/223] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:11:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:11.634917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f09d19-2741-4f59-8810-110211e1f59a None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:11.647659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a2b94-dd13-43eb-a3cc-e4a8e4c6fe0b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:11.690901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fdd96-58f6-4922-8170-747c796fde2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:11.692092 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fdd96-58f6-4922-8170-747c796fde2d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:11.692999 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fdd96-58f6-4922-8170-747c796fde2d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:11.693376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fdd96-58f6-4922-8170-747c796fde2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:11.705057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fdd96-58f6-4922-8170-747c796fde2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-a28fdd96-58f6-4922-8170-747c796fde2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:11.714420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:11.715562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:11.716840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:11.718557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 106/224] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:11:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:11.719518 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fdd96-58f6-4922-8170-747c796fde2d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:11.768334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f09d19-2741-4f59-8810-110211e1f59a None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:11.811233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85374-4ebb-4e4b-b129-faff9b10fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:11.812476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85374-4ebb-4e4b-b129-faff9b10fc1c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:11.812693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85374-4ebb-4e4b-b129-faff9b10fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:11.813043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85374-4ebb-4e4b-b129-faff9b10fc1c None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:11.814423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa85374-4ebb-4e4b-b129-faff9b10fc1c None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:11.816246 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa85374-4ebb-4e4b-b129-faff9b10fc1c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:11.818618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 119/225] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:11 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:11.820675 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85374-4ebb-4e4b-b129-faff9b10fc1c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:11.845600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fdd96-58f6-4922-8170-747c796fde2d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:11.855687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:11.866112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:11.891259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01064289-f48f-4d32-9c1f-3ed09539117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:11.892244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064289-f48f-4d32-9c1f-3ed09539117e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:11.892629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064289-f48f-4d32-9c1f-3ed09539117e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:11.893008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01064289-f48f-4d32-9c1f-3ed09539117e None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:11.893877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01064289-f48f-4d32-9c1f-3ed09539117e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:11.894367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01064289-f48f-4d32-9c1f-3ed09539117e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:11.896118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01064289-f48f-4d32-9c1f-3ed09539117e None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:11.905422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 107/226] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:11.906437 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01064289-f48f-4d32-9c1f-3ed09539117e None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:11.962253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85374-4ebb-4e4b-b129-faff9b10fc1c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:12.007223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfa682-9543-4582-bc11-31eb0efd94bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:12.008362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa682-9543-4582-bc11-31eb0efd94bb None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:12.008922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa682-9543-4582-bc11-31eb0efd94bb None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:12.009213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa682-9543-4582-bc11-31eb0efd94bb None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:12.010273 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfa682-9543-4582-bc11-31eb0efd94bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:12.010596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfa682-9543-4582-bc11-31eb0efd94bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:12.012751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfa682-9543-4582-bc11-31eb0efd94bb None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:12.024523 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01064289-f48f-4d32-9c1f-3ed09539117e None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:12.035234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 120/227] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:12.037216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfa682-9543-4582-bc11-31eb0efd94bb None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:12.067046 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a1c3f-d13d-480a-ac77-121833550e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:12.068406 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a1c3f-d13d-480a-ac77-121833550e6c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:12.068685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a1c3f-d13d-480a-ac77-121833550e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:12.068959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a1c3f-d13d-480a-ac77-121833550e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:12.070358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a1c3f-d13d-480a-ac77-121833550e6c None admin] RBAC: Adding query filter params (role.id=531d1ead7d164c708ad131b14d2f9301, scope.project.id=75585a6ed1724a4199c43e9f777fe503, user.id=7618a60dcea6435780f1536aeed614f6) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:12.070675 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a1c3f-d13d-480a-ac77-121833550e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:12.072684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a1c3f-d13d-480a-ac77-121833550e6c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:12.080938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 108/228] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:11 2022] GET /identity/v3/role_assignments?user.id=7618a60dcea6435780f1536aeed614f6&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:12.084846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a1c3f-d13d-480a-ac77-121833550e6c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:12.179876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:12.202427 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:12.229210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfa682-9543-4582-bc11-31eb0efd94bb None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:12.293891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d35f5e-0501-4f77-b180-fc2130ce3a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:12.294740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d35f5e-0501-4f77-b180-fc2130ce3a1d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:12.295074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d35f5e-0501-4f77-b180-fc2130ce3a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:12.295355 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d35f5e-0501-4f77-b180-fc2130ce3a1d None admin] PATH_INFO: `/v3/users/9bda687ebbd24d7890e540f9ef3aa41c` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:12.296325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a1c3f-d13d-480a-ac77-121833550e6c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:12.296573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d35f5e-0501-4f77-b180-fc2130ce3a1d None admin] RBAC: Authorizing `identity:get_user(user_id=9bda687ebbd24d7890e540f9ef3aa41c)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:12.298020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d35f5e-0501-4f77-b180-fc2130ce3a1d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:12.300115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 121/229] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:12 2022] GET /identity/v3/users/9bda687ebbd24d7890e540f9ef3aa41c => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:12.305726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d35f5e-0501-4f77-b180-fc2130ce3a1d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:12.331323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3f1c7-6ce0-4c38-a005-983dbceb62bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:12.332240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3f1c7-6ce0-4c38-a005-983dbceb62bc None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:12.332530 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3f1c7-6ce0-4c38-a005-983dbceb62bc None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:12.332814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3f1c7-6ce0-4c38-a005-983dbceb62bc None admin] PATH_INFO: `/v3/users/9bda687ebbd24d7890e540f9ef3aa41c` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:12.334557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3f1c7-6ce0-4c38-a005-983dbceb62bc None admin] RBAC: Authorizing `identity:get_user(user_id=9bda687ebbd24d7890e540f9ef3aa41c)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:12.336046 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3f1c7-6ce0-4c38-a005-983dbceb62bc None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:12.337980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 109/230] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:12 2022] GET /identity/v3/users/9bda687ebbd24d7890e540f9ef3aa41c => generated 283 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:12.343499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3f1c7-6ce0-4c38-a005-983dbceb62bc None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:12.417765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d35f5e-0501-4f77-b180-fc2130ce3a1d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:12.445664 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3f1c7-6ce0-4c38-a005-983dbceb62bc None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:12.452962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:12.455521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724f057-43e1-4620-b3ff-e3f164c40027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:12.456742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f057-43e1-4620-b3ff-e3f164c40027 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:12.457223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f057-43e1-4620-b3ff-e3f164c40027 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:12.457696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f057-43e1-4620-b3ff-e3f164c40027 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:12.460060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724f057-43e1-4620-b3ff-e3f164c40027 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:12.462568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724f057-43e1-4620-b3ff-e3f164c40027 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:12.465057 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 122/231] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:12 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:12.477090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724f057-43e1-4620-b3ff-e3f164c40027 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:12.490090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b3622-2bb5-4049-bcb8-1542d9f393f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:12.490979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3622-2bb5-4049-bcb8-1542d9f393f3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:12.491265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3622-2bb5-4049-bcb8-1542d9f393f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:12.491557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b3622-2bb5-4049-bcb8-1542d9f393f3 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:12.497081 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b3622-2bb5-4049-bcb8-1542d9f393f3 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:12.498524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b3622-2bb5-4049-bcb8-1542d9f393f3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:12.500673 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 110/232] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:12 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:12.506872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b3622-2bb5-4049-bcb8-1542d9f393f3 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:12.510257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:12.596103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724f057-43e1-4620-b3ff-e3f164c40027 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:12.633384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679dee3-17a7-4911-a29f-cba981501d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:12.634542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679dee3-17a7-4911-a29f-cba981501d26 None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:12.634924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679dee3-17a7-4911-a29f-cba981501d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:12.635300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679dee3-17a7-4911-a29f-cba981501d26 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503/users/9bda687ebbd24d7890e540f9ef3aa41c/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:12.637576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679dee3-17a7-4911-a29f-cba981501d26 None admin] RBAC: Authorizing `identity:create_grant(project_id=75585a6ed1724a4199c43e9f777fe503, user_id=9bda687ebbd24d7890e540f9ef3aa41c, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:12.639145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679dee3-17a7-4911-a29f-cba981501d26 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:12.655428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 123/233] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:11:12 2022] PUT /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503/users/9bda687ebbd24d7890e540f9ef3aa41c/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:12.730185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b3622-2bb5-4049-bcb8-1542d9f393f3 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:12.768258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d48c0-3b2c-4c5b-92e4-53e2c6a3b9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:12.769223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d48c0-3b2c-4c5b-92e4-53e2c6a3b9a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:12.769738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d48c0-3b2c-4c5b-92e4-53e2c6a3b9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:12.770026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d48c0-3b2c-4c5b-92e4-53e2c6a3b9a1 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503/users/9bda687ebbd24d7890e540f9ef3aa41c/roles/bad10ed55f6140b882d1fdd6994f1fa8` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:12.773417 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d48c0-3b2c-4c5b-92e4-53e2c6a3b9a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=75585a6ed1724a4199c43e9f777fe503, user_id=9bda687ebbd24d7890e540f9ef3aa41c, role_id=bad10ed55f6140b882d1fdd6994f1fa8)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:12.774944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d48c0-3b2c-4c5b-92e4-53e2c6a3b9a1 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:12.792401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 111/234] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:11:12 2022] PUT /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503/users/9bda687ebbd24d7890e540f9ef3aa41c/roles/bad10ed55f6140b882d1fdd6994f1fa8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:13.656677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17c26-b71c-4bcc-bac4-b2404649eaeb None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:13.657203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17c26-b71c-4bcc-bac4-b2404649eaeb None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:13.657310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17c26-b71c-4bcc-bac4-b2404649eaeb None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:13.658595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 124/235] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:13.675164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b275a-9f13-497a-9d62-d22c4d6ab350 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:13.675457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b275a-9f13-497a-9d62-d22c4d6ab350 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:13.675741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b275a-9f13-497a-9d62-d22c4d6ab350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:13.703988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-3b7b275a-9f13-497a-9d62-d22c4d6ab350 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:13.705195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3b7b275a-9f13-497a-9d62-d22c4d6ab350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:13.738946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:13.797900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 112/236] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:13.827660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17c26-b71c-4bcc-bac4-b2404649eaeb None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:13.877377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa50c58-1dc9-45ca-8f81-a7d0afc24f5b None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:13.877693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa50c58-1dc9-45ca-8f81-a7d0afc24f5b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:13.877945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa50c58-1dc9-45ca-8f81-a7d0afc24f5b None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:13.879325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 113/237] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:11:13.889162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65cb3-ef34-4226-8b22-5a5bd4cd6e0d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:13.889451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65cb3-ef34-4226-8b22-5a5bd4cd6e0d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:13.889732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65cb3-ef34-4226-8b22-5a5bd4cd6e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:13.918367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-85a65cb3-ef34-4226-8b22-5a5bd4cd6e0d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:13.920463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-85a65cb3-ef34-4226-8b22-5a5bd4cd6e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:13.961953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:13.977555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17c26-b71c-4bcc-bac4-b2404649eaeb None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:14.041873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc4f14-7833-4201-9c6b-7a5cd1be2e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:14.042684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4f14-7833-4201-9c6b-7a5cd1be2e7c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:14.042973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4f14-7833-4201-9c6b-7a5cd1be2e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:14.043254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4f14-7833-4201-9c6b-7a5cd1be2e7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:14.065119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc4f14-7833-4201-9c6b-7a5cd1be2e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-22fc4f14-7833-4201-9c6b-7a5cd1be2e7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:14.075139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:14.076081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:14.076877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 125/238] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:14.082053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc4f14-7833-4201-9c6b-7a5cd1be2e7c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:14.100510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 114/239] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:14.125967 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a65cb3-ef34-4226-8b22-5a5bd4cd6e0d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:14.256480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:14.258519 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a65cb3-ef34-4226-8b22-5a5bd4cd6e0d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:14.283194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc4f14-7833-4201-9c6b-7a5cd1be2e7c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:14.329965 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf3e7-f9fd-4341-a74a-0b9beb2ab13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:14.330774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf3e7-f9fd-4341-a74a-0b9beb2ab13e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:14.331062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf3e7-f9fd-4341-a74a-0b9beb2ab13e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:14.331342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf3e7-f9fd-4341-a74a-0b9beb2ab13e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:14.333753 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccf3e7-f9fd-4341-a74a-0b9beb2ab13e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:14.335217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccf3e7-f9fd-4341-a74a-0b9beb2ab13e None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:14.336884 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 115/240] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:14.342783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf3e7-f9fd-4341-a74a-0b9beb2ab13e None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:14.354320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b4fc4-ad70-4bf5-b854-a40aefef7cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:14.355008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b4fc4-ad70-4bf5-b854-a40aefef7cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:14.355293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b4fc4-ad70-4bf5-b854-a40aefef7cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:14.355570 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b4fc4-ad70-4bf5-b854-a40aefef7cd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:14.356357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b4fc4-ad70-4bf5-b854-a40aefef7cd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:14.356671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b4fc4-ad70-4bf5-b854-a40aefef7cd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:14.358057 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b4fc4-ad70-4bf5-b854-a40aefef7cd1 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:14.375947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 126/241] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:14.381031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b4fc4-ad70-4bf5-b854-a40aefef7cd1 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:14.386054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:14.506289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b4fc4-ad70-4bf5-b854-a40aefef7cd1 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:14.550970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d13d20-a9dd-40d4-b67a-e6f073ee8789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:14.552356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d13d20-a9dd-40d4-b67a-e6f073ee8789 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:14.552648 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d13d20-a9dd-40d4-b67a-e6f073ee8789 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:14.552931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d13d20-a9dd-40d4-b67a-e6f073ee8789 None admin] PATH_INFO: `/v3/users/082e60f9378147c3b80f8301f3b894a5` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:14.561252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf3e7-f9fd-4341-a74a-0b9beb2ab13e None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:14.597525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d13d20-a9dd-40d4-b67a-e6f073ee8789 None admin] RBAC: Authorizing `identity:get_user(user_id=082e60f9378147c3b80f8301f3b894a5)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:14.599072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d13d20-a9dd-40d4-b67a-e6f073ee8789 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:14.601139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 127/242] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:14 2022] GET /identity/v3/users/082e60f9378147c3b80f8301f3b894a5 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:14.608167 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d13d20-a9dd-40d4-b67a-e6f073ee8789 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:14.619371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60acf2-feaa-4c46-b058-6093152a5c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:14.620083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60acf2-feaa-4c46-b058-6093152a5c31 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:14.620887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60acf2-feaa-4c46-b058-6093152a5c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:14.621177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60acf2-feaa-4c46-b058-6093152a5c31 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:14.621906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60acf2-feaa-4c46-b058-6093152a5c31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:14.623840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60acf2-feaa-4c46-b058-6093152a5c31 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:14.653034 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 116/243] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:11:14 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:11:14.654352 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe88d2-ecb2-4f6a-be80-db84ee0d5444 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:14.654647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe88d2-ecb2-4f6a-be80-db84ee0d5444 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:14.654994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe88d2-ecb2-4f6a-be80-db84ee0d5444 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:14.656551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 117/244] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:14.663892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e6fe0-e812-4663-a423-5712e0718fbb None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:14.664273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e6fe0-e812-4663-a423-5712e0718fbb None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:14.664560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e6fe0-e812-4663-a423-5712e0718fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:14.689112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ec7e6fe0-e812-4663-a423-5712e0718fbb None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:14.690337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ec7e6fe0-e812-4663-a423-5712e0718fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:14.709381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:14.719386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:14.775103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 118/245] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:14.816512 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d13d20-a9dd-40d4-b67a-e6f073ee8789 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:14.830042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e6fe0-e812-4663-a423-5712e0718fbb None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:14.865945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5952008-0f04-4a55-ab99-b32f6daa50c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:14.866625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952008-0f04-4a55-ab99-b32f6daa50c9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:14.866913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952008-0f04-4a55-ab99-b32f6daa50c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:14.867191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952008-0f04-4a55-ab99-b32f6daa50c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:14.964712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5952008-0f04-4a55-ab99-b32f6daa50c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:14.967236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5952008-0f04-4a55-ab99-b32f6daa50c9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:14.975680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e6fe0-e812-4663-a423-5712e0718fbb None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:15.033852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb3f1c-2fba-4ee9-84d8-9e9984b7a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:15.034921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3f1c-2fba-4ee9-84d8-9e9984b7a422 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:15.035410 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3f1c-2fba-4ee9-84d8-9e9984b7a422 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:15.035916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3f1c-2fba-4ee9-84d8-9e9984b7a422 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:15.042530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:15.053982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb3f1c-2fba-4ee9-84d8-9e9984b7a422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-2cdb3f1c-2fba-4ee9-84d8-9e9984b7a422 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:15.065372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:15.066377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:15.067231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:15.070153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 119/246] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:15.076220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb3f1c-2fba-4ee9-84d8-9e9984b7a422 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:15.091486 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:15.091755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 128/247] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:11:15.098467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5952008-0f04-4a55-ab99-b32f6daa50c9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:15.200777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb3f1c-2fba-4ee9-84d8-9e9984b7a422 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:15.237684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5952008-0f04-4a55-ab99-b32f6daa50c9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:15.245907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85340c03-a446-4c7d-ba82-d913460b1119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:15.246586 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85340c03-a446-4c7d-ba82-d913460b1119 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:15.246871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85340c03-a446-4c7d-ba82-d913460b1119 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:15.247151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85340c03-a446-4c7d-ba82-d913460b1119 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:15.248530 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85340c03-a446-4c7d-ba82-d913460b1119 None admin] RBAC: Adding query filter params (name=member) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:15.249078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85340c03-a446-4c7d-ba82-d913460b1119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:15.252055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85340c03-a446-4c7d-ba82-d913460b1119 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:15.264588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 120/248] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:15.269987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85340c03-a446-4c7d-ba82-d913460b1119 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:15.287905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c70f83-05a3-4e98-9617-41801c9033b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:15.289386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70f83-05a3-4e98-9617-41801c9033b9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:15.290023 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70f83-05a3-4e98-9617-41801c9033b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:15.290679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70f83-05a3-4e98-9617-41801c9033b9 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:15.292725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c70f83-05a3-4e98-9617-41801c9033b9 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:15.295092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c70f83-05a3-4e98-9617-41801c9033b9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:15.297129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 129/249] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:15 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:15.304907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c70f83-05a3-4e98-9617-41801c9033b9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:15.356294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:15.378653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:15.428845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85340c03-a446-4c7d-ba82-d913460b1119 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:15.456490 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c70f83-05a3-4e98-9617-41801c9033b9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:15.473338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aace98-608b-4124-a8de-52d48f073a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:15.474949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aace98-608b-4124-a8de-52d48f073a11 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:15.475242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aace98-608b-4124-a8de-52d48f073a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:15.475527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aace98-608b-4124-a8de-52d48f073a11 None admin] PATH_INFO: `/v3/users/7618a60dcea6435780f1536aeed614f6` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:15.477086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aace98-608b-4124-a8de-52d48f073a11 None admin] RBAC: Authorizing `identity:get_user(user_id=7618a60dcea6435780f1536aeed614f6)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:15.478935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aace98-608b-4124-a8de-52d48f073a11 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:15.481525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 121/250] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:15 2022] GET /identity/v3/users/7618a60dcea6435780f1536aeed614f6 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:15.483053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90aca5-e17c-439f-91f4-224bb254c189 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:15.483347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90aca5-e17c-439f-91f4-224bb254c189 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:15.483631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90aca5-e17c-439f-91f4-224bb254c189 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:15.488007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 122/251] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:15.488007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90aca5-e17c-439f-91f4-224bb254c189 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:15.500526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c8996-8c16-4d10-92c9-a57cd4e89741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:15.501643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c8996-8c16-4d10-92c9-a57cd4e89741 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:15.502029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c8996-8c16-4d10-92c9-a57cd4e89741 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:15.502408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c8996-8c16-4d10-92c9-a57cd4e89741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:15.503413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c8996-8c16-4d10-92c9-a57cd4e89741 None admin] RBAC: Adding query filter params (role.id=725793cd452f4a0b9bcacc1754592b62, scope.project.id=75585a6ed1724a4199c43e9f777fe503, user.id=082e60f9378147c3b80f8301f3b894a5) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:15.503832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c8996-8c16-4d10-92c9-a57cd4e89741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:15.506081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c8996-8c16-4d10-92c9-a57cd4e89741 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:15.512312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 130/252] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:15 2022] GET /identity/v3/role_assignments?user.id=082e60f9378147c3b80f8301f3b894a5&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=725793cd452f4a0b9bcacc1754592b62 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:15.513676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688308a0-3c17-4c8f-938a-db2e09872199 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:15.514173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688308a0-3c17-4c8f-938a-db2e09872199 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:15.514521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688308a0-3c17-4c8f-938a-db2e09872199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:15.535886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-688308a0-3c17-4c8f-938a-db2e09872199 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:15.535886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-688308a0-3c17-4c8f-938a-db2e09872199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:15.662741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 131/253] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:15.668915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333848-5bbc-4dce-bba9-1f5d3a13fc47 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:15.669264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333848-5bbc-4dce-bba9-1f5d3a13fc47 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:15.669548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333848-5bbc-4dce-bba9-1f5d3a13fc47 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:15.671128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 132/254] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:15.676019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90aca5-e17c-439f-91f4-224bb254c189 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:15.677206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ffb75-f089-4f85-b5f3-4e4366ffc749 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:15.677500 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ffb75-f089-4f85-b5f3-4e4366ffc749 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:15.677913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ffb75-f089-4f85-b5f3-4e4366ffc749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:15.706769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-611ffb75-f089-4f85-b5f3-4e4366ffc749 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:15.708093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-611ffb75-f089-4f85-b5f3-4e4366ffc749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:15.734113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:15.755276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9c5b6-0757-4f68-bd47-daafab739815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:15.756242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9c5b6-0757-4f68-bd47-daafab739815 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:15.756525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9c5b6-0757-4f68-bd47-daafab739815 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:15.756806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9c5b6-0757-4f68-bd47-daafab739815 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:15.758123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9c5b6-0757-4f68-bd47-daafab739815 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:15.759581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9c5b6-0757-4f68-bd47-daafab739815 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:15.764371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 123/255] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:15 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:15.765161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9c5b6-0757-4f68-bd47-daafab739815 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:15.779648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:15.840662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 133/256] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:15.841756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ffb75-f089-4f85-b5f3-4e4366ffc749 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:15.929943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9c5b6-0757-4f68-bd47-daafab739815 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:15.965485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78a3b2-81c6-422a-b419-dd13a9201f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:15.966970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78a3b2-81c6-422a-b419-dd13a9201f1a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:15.967458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78a3b2-81c6-422a-b419-dd13a9201f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:15.967936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78a3b2-81c6-422a-b419-dd13a9201f1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:15.979318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78a3b2-81c6-422a-b419-dd13a9201f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-7b78a3b2-81c6-422a-b419-dd13a9201f1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:15.987490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:15.988400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:15.989719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:15.992092 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 124/257] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:15.993072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78a3b2-81c6-422a-b419-dd13a9201f1a None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:16.009351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ffb75-f089-4f85-b5f3-4e4366ffc749 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:16.081204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d1579-af8a-4cc0-b17d-70b8c02a1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:16.082115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d1579-af8a-4cc0-b17d-70b8c02a1b7f None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:16.082451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d1579-af8a-4cc0-b17d-70b8c02a1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:16.082728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d1579-af8a-4cc0-b17d-70b8c02a1b7f None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503/users/7618a60dcea6435780f1536aeed614f6/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:16.086365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d1579-af8a-4cc0-b17d-70b8c02a1b7f None admin] RBAC: Authorizing `identity:create_grant(project_id=75585a6ed1724a4199c43e9f777fe503, user_id=7618a60dcea6435780f1536aeed614f6, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:16.087849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d1579-af8a-4cc0-b17d-70b8c02a1b7f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:16.115749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 134/258] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:11:15 2022] PUT /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503/users/7618a60dcea6435780f1536aeed614f6/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:16.116625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d1579-af8a-4cc0-b17d-70b8c02a1b7f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:16.126040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:16.153388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:16.170342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78a3b2-81c6-422a-b419-dd13a9201f1a None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:16.206664 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336a7b2-7ac1-465f-8c04-0a93cf40fa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:16.207400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a7b2-7ac1-465f-8c04-0a93cf40fa2a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:16.207687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a7b2-7ac1-465f-8c04-0a93cf40fa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:16.208044 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336a7b2-7ac1-465f-8c04-0a93cf40fa2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:16.230187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336a7b2-7ac1-465f-8c04-0a93cf40fa2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-c336a7b2-7ac1-465f-8c04-0a93cf40fa2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:16.238413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:16.239349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:16.240205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 125/259] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:11:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:16.245704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336a7b2-7ac1-465f-8c04-0a93cf40fa2a None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:16.337878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d1579-af8a-4cc0-b17d-70b8c02a1b7f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:16.361228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336a7b2-7ac1-465f-8c04-0a93cf40fa2a None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:16.386761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ca35f-03a2-4696-a0aa-261ca9cec24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:16.387450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca35f-03a2-4696-a0aa-261ca9cec24e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:16.387737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca35f-03a2-4696-a0aa-261ca9cec24e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:16.388062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca35f-03a2-4696-a0aa-261ca9cec24e None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:16.388830 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ca35f-03a2-4696-a0aa-261ca9cec24e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:16.389145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ca35f-03a2-4696-a0aa-261ca9cec24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:16.390682 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ca35f-03a2-4696-a0aa-261ca9cec24e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:16.400681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 135/260] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:16.408223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ca35f-03a2-4696-a0aa-261ca9cec24e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:16.425782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:16.440732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43840c-e1ff-4f32-b28c-354326bf5fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:16.441413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43840c-e1ff-4f32-b28c-354326bf5fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:16.441701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43840c-e1ff-4f32-b28c-354326bf5fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:16.441982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43840c-e1ff-4f32-b28c-354326bf5fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:16.442790 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43840c-e1ff-4f32-b28c-354326bf5fb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:16.443110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43840c-e1ff-4f32-b28c-354326bf5fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:16.444563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43840c-e1ff-4f32-b28c-354326bf5fb0 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:16.459638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 126/261] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:16.465113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43840c-e1ff-4f32-b28c-354326bf5fb0 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:16.556384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:16.600152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ca35f-03a2-4696-a0aa-261ca9cec24e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:16.649315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43840c-e1ff-4f32-b28c-354326bf5fb0 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:16.653757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d38435-f70f-4f20-ba7c-7f1ab9a13d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:16.654890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38435-f70f-4f20-ba7c-7f1ab9a13d5f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:16.655376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38435-f70f-4f20-ba7c-7f1ab9a13d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:16.655886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38435-f70f-4f20-ba7c-7f1ab9a13d5f None admin] PATH_INFO: `/v3/users/9bda687ebbd24d7890e540f9ef3aa41c` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:16.658884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d38435-f70f-4f20-ba7c-7f1ab9a13d5f None admin] RBAC: Authorizing `identity:get_user(user_id=9bda687ebbd24d7890e540f9ef3aa41c)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:16.660719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d38435-f70f-4f20-ba7c-7f1ab9a13d5f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:16.663206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 136/262] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:16 2022] GET /identity/v3/users/9bda687ebbd24d7890e540f9ef3aa41c => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:16.670041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d38435-f70f-4f20-ba7c-7f1ab9a13d5f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:16.717661 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf39d5-a4c0-4b5b-99a5-53e9f310ae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:16.718597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf39d5-a4c0-4b5b-99a5-53e9f310ae26 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:16.718896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf39d5-a4c0-4b5b-99a5-53e9f310ae26 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:16.719178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf39d5-a4c0-4b5b-99a5-53e9f310ae26 None admin] PATH_INFO: `/v3/users/9bda687ebbd24d7890e540f9ef3aa41c` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:16.720438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf39d5-a4c0-4b5b-99a5-53e9f310ae26 None admin] RBAC: Authorizing `identity:get_user(user_id=9bda687ebbd24d7890e540f9ef3aa41c)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:16.721916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf39d5-a4c0-4b5b-99a5-53e9f310ae26 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:16.727837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 127/263] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:16 2022] GET /identity/v3/users/9bda687ebbd24d7890e540f9ef3aa41c => generated 283 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:16.728961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf39d5-a4c0-4b5b-99a5-53e9f310ae26 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:16.853201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:16.887174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d38435-f70f-4f20-ba7c-7f1ab9a13d5f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:16.937204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851ca6-fd37-4743-a25a-1ae13ed8d53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:16.937882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851ca6-fd37-4743-a25a-1ae13ed8d53e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:16.938173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851ca6-fd37-4743-a25a-1ae13ed8d53e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:16.938455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9851ca6-fd37-4743-a25a-1ae13ed8d53e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:16.968412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:16.986004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf39d5-a4c0-4b5b-99a5-53e9f310ae26 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:17.074401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9851ca6-fd37-4743-a25a-1ae13ed8d53e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:17.076264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9851ca6-fd37-4743-a25a-1ae13ed8d53e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:17.092193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a377068-a390-4fae-8433-de5d8fe6726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:17.092861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a377068-a390-4fae-8433-de5d8fe6726a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:17.093152 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a377068-a390-4fae-8433-de5d8fe6726a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:17.093436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a377068-a390-4fae-8433-de5d8fe6726a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:17.255199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a377068-a390-4fae-8433-de5d8fe6726a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:17.256628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a377068-a390-4fae-8433-de5d8fe6726a None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:17.259726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 137/264] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:11:17.265165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851ca6-fd37-4743-a25a-1ae13ed8d53e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:17.336309 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:17.389357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:17.419676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9851ca6-fd37-4743-a25a-1ae13ed8d53e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:17.468070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38006e-508f-4135-baf4-91091d118d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:17.468946 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38006e-508f-4135-baf4-91091d118d91 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:17.469229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38006e-508f-4135-baf4-91091d118d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:17.469504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38006e-508f-4135-baf4-91091d118d91 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:17.473774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38006e-508f-4135-baf4-91091d118d91 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:17.475241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38006e-508f-4135-baf4-91091d118d91 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:17.478759 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 138/265] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:17 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:17.485264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38006e-508f-4135-baf4-91091d118d91 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:17.503899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 128/266] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:11:17.509804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a377068-a390-4fae-8433-de5d8fe6726a None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:17.671173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a377068-a390-4fae-8433-de5d8fe6726a None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:17.719340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37720b-5c0d-4042-b587-d902aebc34b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:17.720779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37720b-5c0d-4042-b587-d902aebc34b4 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:17.721068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37720b-5c0d-4042-b587-d902aebc34b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:17.721352 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37720b-5c0d-4042-b587-d902aebc34b4 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:17.722567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37720b-5c0d-4042-b587-d902aebc34b4 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:17.724587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37720b-5c0d-4042-b587-d902aebc34b4 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:17.727171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 129/267] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:17 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:17.736226 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37720b-5c0d-4042-b587-d902aebc34b4 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:17.742205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38006e-508f-4135-baf4-91091d118d91 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:17.763040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:17.790658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:17.832985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544c5ef-fff7-490b-bd41-88e20d5571d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:17.833680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544c5ef-fff7-490b-bd41-88e20d5571d0 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:17.833961 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544c5ef-fff7-490b-bd41-88e20d5571d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:17.834236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544c5ef-fff7-490b-bd41-88e20d5571d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:17.835080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544c5ef-fff7-490b-bd41-88e20d5571d0 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=75585a6ed1724a4199c43e9f777fe503, user.id=9bda687ebbd24d7890e540f9ef3aa41c) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:17.835398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544c5ef-fff7-490b-bd41-88e20d5571d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:17.836877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544c5ef-fff7-490b-bd41-88e20d5571d0 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:17.847419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 139/268] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:17 2022] GET /identity/v3/role_assignments?user.id=9bda687ebbd24d7890e540f9ef3aa41c&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 608 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:17.912372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37720b-5c0d-4042-b587-d902aebc34b4 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:17.949947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2928a9-5420-4793-bb33-36814d2940c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:17.950630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2928a9-5420-4793-bb33-36814d2940c9 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:17.950918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2928a9-5420-4793-bb33-36814d2940c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:17.951201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2928a9-5420-4793-bb33-36814d2940c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:17.952090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2928a9-5420-4793-bb33-36814d2940c9 None admin] RBAC: Adding query filter params (role.id=bad10ed55f6140b882d1fdd6994f1fa8, scope.project.id=75585a6ed1724a4199c43e9f777fe503, user.id=9bda687ebbd24d7890e540f9ef3aa41c) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:17.952416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2928a9-5420-4793-bb33-36814d2940c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:17.953939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2928a9-5420-4793-bb33-36814d2940c9 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:17.961119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 130/269] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:17 2022] GET /identity/v3/role_assignments?user.id=9bda687ebbd24d7890e540f9ef3aa41c&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=bad10ed55f6140b882d1fdd6994f1fa8 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:18.236339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca816-6c2e-4f68-a778-03992359f396 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:18.236848 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca816-6c2e-4f68-a778-03992359f396 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:18.236948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca816-6c2e-4f68-a778-03992359f396 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:18.238573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 140/270] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:18.244598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04d4b-f812-4681-a719-5ea42c0a24e7 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:18.244886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04d4b-f812-4681-a719-5ea42c0a24e7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:18.245178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04d4b-f812-4681-a719-5ea42c0a24e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:18.264495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e6b04d4b-f812-4681-a719-5ea42c0a24e7 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:18.265748 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e6b04d4b-f812-4681-a719-5ea42c0a24e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:18.336528 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4a0a-0355-4988-934b-d20189df131a None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:18.336829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4a0a-0355-4988-934b-d20189df131a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:18.337073 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae4a0a-0355-4988-934b-d20189df131a None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:18.338753 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 141/271] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:18.344616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153c20-a6a0-4fbb-b2fb-cc45ad4ebb25 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:18.344908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153c20-a6a0-4fbb-b2fb-cc45ad4ebb25 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:18.345190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55153c20-a6a0-4fbb-b2fb-cc45ad4ebb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:18.353223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 131/272] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:18.371920 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-55153c20-a6a0-4fbb-b2fb-cc45ad4ebb25 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:18.373144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-55153c20-a6a0-4fbb-b2fb-cc45ad4ebb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:18.385525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04d4b-f812-4681-a719-5ea42c0a24e7 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:18.410346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:18.465679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 142/273] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:18.467390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16133f8f-7ef9-4ffa-93a4-b8e617881452 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:18.467730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16133f8f-7ef9-4ffa-93a4-b8e617881452 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:18.468040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16133f8f-7ef9-4ffa-93a4-b8e617881452 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:18.469632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 143/274] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:18.474877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e777eb0-8182-4241-8a66-bc1ac851de65 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:18.475170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e777eb0-8182-4241-8a66-bc1ac851de65 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:18.475456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e777eb0-8182-4241-8a66-bc1ac851de65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:18.498862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-3e777eb0-8182-4241-8a66-bc1ac851de65 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:18.503993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3e777eb0-8182-4241-8a66-bc1ac851de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:18.522698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04d4b-f812-4681-a719-5ea42c0a24e7 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:18.557807 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4a588-6500-4745-9ae5-43a4ed307625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:18.558609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4a588-6500-4745-9ae5-43a4ed307625 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:18.558894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4a588-6500-4745-9ae5-43a4ed307625 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:18.559176 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4a588-6500-4745-9ae5-43a4ed307625 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:18.570097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4a588-6500-4745-9ae5-43a4ed307625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:18.573266 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 144/275] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:18.574032 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e777eb0-8182-4241-8a66-bc1ac851de65 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-12c4a588-6500-4745-9ae5-43a4ed307625 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:18.585013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:18.585935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:18.586942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 132/276] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:11:18.593522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4a588-6500-4745-9ae5-43a4ed307625 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:18.619033 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:18.684850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:18.689978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e777eb0-8182-4241-8a66-bc1ac851de65 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:18.712373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4a588-6500-4745-9ae5-43a4ed307625 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:18.728886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d66de-061c-4118-b6e3-0c09269538a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:18.729698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d66de-061c-4118-b6e3-0c09269538a6 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:18.729988 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d66de-061c-4118-b6e3-0c09269538a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:18.730268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d66de-061c-4118-b6e3-0c09269538a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:18.731471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d66de-061c-4118-b6e3-0c09269538a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:18.733042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d66de-061c-4118-b6e3-0c09269538a6 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:18.734632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 145/277] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:18.735400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d66de-061c-4118-b6e3-0c09269538a6 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:18.751384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fc72e-0745-4276-83e6-8a2fb298a97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:18.752168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fc72e-0745-4276-83e6-8a2fb298a97a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:18.752458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fc72e-0745-4276-83e6-8a2fb298a97a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:18.752735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fc72e-0745-4276-83e6-8a2fb298a97a None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:18.753488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fc72e-0745-4276-83e6-8a2fb298a97a None admin] RBAC: Adding query filter params (name=member) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:18.753802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fc72e-0745-4276-83e6-8a2fb298a97a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:18.755729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fc72e-0745-4276-83e6-8a2fb298a97a None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:18.764139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 133/278] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:18.769134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fc72e-0745-4276-83e6-8a2fb298a97a None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:18.843306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d66de-061c-4118-b6e3-0c09269538a6 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:18.845979 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:18.883055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fc72e-0745-4276-83e6-8a2fb298a97a None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:18.883283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db3e42-4af5-4dc2-b51d-66cca8b7932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:18.883931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db3e42-4af5-4dc2-b51d-66cca8b7932d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:18.884242 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db3e42-4af5-4dc2-b51d-66cca8b7932d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:18.884515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db3e42-4af5-4dc2-b51d-66cca8b7932d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:18.895612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db3e42-4af5-4dc2-b51d-66cca8b7932d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-e3db3e42-4af5-4dc2-b51d-66cca8b7932d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:18.903396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:18.904299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:18.905102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 146/279] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:18.906710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db3e42-4af5-4dc2-b51d-66cca8b7932d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:18.923381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be20df-c4bc-4d5b-a39a-e3e673e5f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:18.924088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be20df-c4bc-4d5b-a39a-e3e673e5f65f None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:18.924377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be20df-c4bc-4d5b-a39a-e3e673e5f65f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:18.924657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be20df-c4bc-4d5b-a39a-e3e673e5f65f None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:18.925366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be20df-c4bc-4d5b-a39a-e3e673e5f65f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:18.927316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be20df-c4bc-4d5b-a39a-e3e673e5f65f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:18.937749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:18.951571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 134/280] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:11:18 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:11:18.952778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be20df-c4bc-4d5b-a39a-e3e673e5f65f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:19.036545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db3e42-4af5-4dc2-b51d-66cca8b7932d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:19.079169 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017117e8-765e-4fdf-ae7f-934901c1c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:19.080245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017117e8-765e-4fdf-ae7f-934901c1c353 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:19.080562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017117e8-765e-4fdf-ae7f-934901c1c353 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:19.080845 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017117e8-765e-4fdf-ae7f-934901c1c353 None admin] PATH_INFO: `/v3/users/fd8fb1d3c0494785a5ef83a2141e4599` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:19.100706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017117e8-765e-4fdf-ae7f-934901c1c353 None admin] RBAC: Authorizing `identity:get_user(user_id=fd8fb1d3c0494785a5ef83a2141e4599)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:19.102109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017117e8-765e-4fdf-ae7f-934901c1c353 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:19.103904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 147/281] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:18 2022] GET /identity/v3/users/fd8fb1d3c0494785a5ef83a2141e4599 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:19.105218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883fa18-c9b6-451e-9b61-201ff6d9f077 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:19.105504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883fa18-c9b6-451e-9b61-201ff6d9f077 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:19.105779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883fa18-c9b6-451e-9b61-201ff6d9f077 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:19.108083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 148/282] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:19.111574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883fa18-c9b6-451e-9b61-201ff6d9f077 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:19.116556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be20df-c4bc-4d5b-a39a-e3e673e5f65f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:19.142911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:19.157415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4754d-4c58-4430-97a3-a27087578c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:19.158185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4754d-4c58-4430-97a3-a27087578c3c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:19.158482 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4754d-4c58-4430-97a3-a27087578c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:19.158762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4754d-4c58-4430-97a3-a27087578c3c None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:19.159524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4754d-4c58-4430-97a3-a27087578c3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:19.159844 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4754d-4c58-4430-97a3-a27087578c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:19.161809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4754d-4c58-4430-97a3-a27087578c3c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:19.171489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 135/283] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:19.172832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671a18b-6765-4c80-8567-502f7fd45996 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:19.173123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671a18b-6765-4c80-8567-502f7fd45996 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:19.173405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671a18b-6765-4c80-8567-502f7fd45996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:19.192460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f671a18b-6765-4c80-8567-502f7fd45996 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:19.193670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f671a18b-6765-4c80-8567-502f7fd45996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:19.240904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883fa18-c9b6-451e-9b61-201ff6d9f077 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:19.260352 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:19.280658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 136/284] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:19.280839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd648b-cd49-4fd1-b7a3-4a88fbf20950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:19.281379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd648b-cd49-4fd1-b7a3-4a88fbf20950 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:19.281549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671a18b-6765-4c80-8567-502f7fd45996 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:19.281642 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd648b-cd49-4fd1-b7a3-4a88fbf20950 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:19.281926 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd648b-cd49-4fd1-b7a3-4a88fbf20950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:19.282913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd648b-cd49-4fd1-b7a3-4a88fbf20950 None admin] RBAC: Adding query filter params (role.id=531d1ead7d164c708ad131b14d2f9301, user.id=fd8fb1d3c0494785a5ef83a2141e4599, scope.system=all) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:19.283254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd648b-cd49-4fd1-b7a3-4a88fbf20950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:19.286541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd648b-cd49-4fd1-b7a3-4a88fbf20950 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:19.293442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 149/285] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jun 16 00:11:19 2022] GET /identity/v3/role_assignments?user.id=fd8fb1d3c0494785a5ef83a2141e4599&scope.system=all&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:19.308958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd648b-cd49-4fd1-b7a3-4a88fbf20950 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:19.401015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671a18b-6765-4c80-8567-502f7fd45996 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:19.455079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:19.459876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dfee2-c756-461b-ac51-78b0d87c4170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:19.461563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dfee2-c756-461b-ac51-78b0d87c4170 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:19.462032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dfee2-c756-461b-ac51-78b0d87c4170 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:19.462468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dfee2-c756-461b-ac51-78b0d87c4170 None admin] PATH_INFO: `/v3/users/082e60f9378147c3b80f8301f3b894a5` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:19.464300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dfee2-c756-461b-ac51-78b0d87c4170 None admin] RBAC: Authorizing `identity:get_user(user_id=082e60f9378147c3b80f8301f3b894a5)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:19.466634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dfee2-c756-461b-ac51-78b0d87c4170 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:19.469444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 137/286] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:19 2022] GET /identity/v3/users/082e60f9378147c3b80f8301f3b894a5 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:19.475568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dfee2-c756-461b-ac51-78b0d87c4170 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:19.486373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd648b-cd49-4fd1-b7a3-4a88fbf20950 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:19.544478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a730e6c-b319-467c-a90c-b54829991bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:19.545729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a730e6c-b319-467c-a90c-b54829991bca None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:19.546215 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a730e6c-b319-467c-a90c-b54829991bca None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:19.546712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a730e6c-b319-467c-a90c-b54829991bca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:19.553435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:19.560852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a730e6c-b319-467c-a90c-b54829991bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-2a730e6c-b319-467c-a90c-b54829991bca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:19.569757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:19.570677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:19.571472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 150/287] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:11:19.576869 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a730e6c-b319-467c-a90c-b54829991bca None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:19.607701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dfee2-c756-461b-ac51-78b0d87c4170 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:19.647327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a945b76-4d41-46ce-ad6f-29f6fa1ae503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:19.648588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a945b76-4d41-46ce-ad6f-29f6fa1ae503 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:19.649180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a945b76-4d41-46ce-ad6f-29f6fa1ae503 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:19.649702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a945b76-4d41-46ce-ad6f-29f6fa1ae503 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:19.651913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a945b76-4d41-46ce-ad6f-29f6fa1ae503 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:19.654195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a945b76-4d41-46ce-ad6f-29f6fa1ae503 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:19.656877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 138/288] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:19 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:19.664186 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a945b76-4d41-46ce-ad6f-29f6fa1ae503 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:19.774823 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a730e6c-b319-467c-a90c-b54829991bca None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:19.798159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a945b76-4d41-46ce-ad6f-29f6fa1ae503 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:19.844094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4f4c-04e6-4f4d-94f4-da3e5ec98c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:19.844774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4f4c-04e6-4f4d-94f4-da3e5ec98c2b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:19.845241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4f4c-04e6-4f4d-94f4-da3e5ec98c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:19.845530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c4f4c-04e6-4f4d-94f4-da3e5ec98c2b None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:19.846646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:19.847630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c4f4c-04e6-4f4d-94f4-da3e5ec98c2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:19.848003 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c4f4c-04e6-4f4d-94f4-da3e5ec98c2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:19.851128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c4f4c-04e6-4f4d-94f4-da3e5ec98c2b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:19.868567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 151/289] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:19.872718 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be7e9-be51-4e9f-81c8-10d55ad8c279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:19.872935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4f4c-04e6-4f4d-94f4-da3e5ec98c2b None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:19.874162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be7e9-be51-4e9f-81c8-10d55ad8c279 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:19.874674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be7e9-be51-4e9f-81c8-10d55ad8c279 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:19.875168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274be7e9-be51-4e9f-81c8-10d55ad8c279 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503/users/082e60f9378147c3b80f8301f3b894a5/roles/725793cd452f4a0b9bcacc1754592b62` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:19.877442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274be7e9-be51-4e9f-81c8-10d55ad8c279 None admin] RBAC: Authorizing `identity:create_grant(project_id=75585a6ed1724a4199c43e9f777fe503, user_id=082e60f9378147c3b80f8301f3b894a5, role_id=725793cd452f4a0b9bcacc1754592b62)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:19.879118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274be7e9-be51-4e9f-81c8-10d55ad8c279 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:19.887580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:19.906711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 139/290] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:11:19 2022] PUT /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503/users/082e60f9378147c3b80f8301f3b894a5/roles/725793cd452f4a0b9bcacc1754592b62 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:20.024206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c4f4c-04e6-4f4d-94f4-da3e5ec98c2b None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:20.077882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ad307-2162-4433-aafe-24fd0701fa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:20.079155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ad307-2162-4433-aafe-24fd0701fa89 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:20.079645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ad307-2162-4433-aafe-24fd0701fa89 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:20.080206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ad307-2162-4433-aafe-24fd0701fa89 None admin] PATH_INFO: `/v3/users/7618a60dcea6435780f1536aeed614f6` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:20.081675 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ad307-2162-4433-aafe-24fd0701fa89 None admin] RBAC: Authorizing `identity:get_user(user_id=7618a60dcea6435780f1536aeed614f6)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:20.083927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ad307-2162-4433-aafe-24fd0701fa89 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:20.086229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 152/291] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:19 2022] GET /identity/v3/users/7618a60dcea6435780f1536aeed614f6 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:20.092186 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be7e9-be51-4e9f-81c8-10d55ad8c279 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:20.206613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274be7e9-be51-4e9f-81c8-10d55ad8c279 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:20.251710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c06ba-9ddc-4c6c-bc58-38f3edab90d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:20.252767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c06ba-9ddc-4c6c-bc58-38f3edab90d1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:20.253254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c06ba-9ddc-4c6c-bc58-38f3edab90d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:20.253870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c06ba-9ddc-4c6c-bc58-38f3edab90d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:20.325208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:20.351387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c06ba-9ddc-4c6c-bc58-38f3edab90d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:20.353193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c06ba-9ddc-4c6c-bc58-38f3edab90d1 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:20.482151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 140/292] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:20.486186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ad307-2162-4433-aafe-24fd0701fa89 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:20.597263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:20.625663 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ad307-2162-4433-aafe-24fd0701fa89 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:20.679078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7baf3d-d97d-42ce-a8a9-af45850c6437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:20.679955 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7baf3d-d97d-42ce-a8a9-af45850c6437 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:20.680259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7baf3d-d97d-42ce-a8a9-af45850c6437 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:20.680537 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7baf3d-d97d-42ce-a8a9-af45850c6437 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:20.681747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7baf3d-d97d-42ce-a8a9-af45850c6437 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:20.683185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7baf3d-d97d-42ce-a8a9-af45850c6437 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:20.685225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 153/293] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:20 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:20.690840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c06ba-9ddc-4c6c-bc58-38f3edab90d1 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:20.825046 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:20.844862 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c06ba-9ddc-4c6c-bc58-38f3edab90d1 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:20.898002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7510a-70c2-42a1-992a-416cb1d8549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:20.898643 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7510a-70c2-42a1-992a-416cb1d8549c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:20.898927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7510a-70c2-42a1-992a-416cb1d8549c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:20.899208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7510a-70c2-42a1-992a-416cb1d8549c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:20.900058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7510a-70c2-42a1-992a-416cb1d8549c None admin] RBAC: Adding query filter params (role.id=531d1ead7d164c708ad131b14d2f9301, scope.project.id=75585a6ed1724a4199c43e9f777fe503, user.id=7618a60dcea6435780f1536aeed614f6) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:20.900380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7510a-70c2-42a1-992a-416cb1d8549c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:20.901811 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7510a-70c2-42a1-992a-416cb1d8549c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:20.912332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 141/294] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:20 2022] GET /identity/v3/role_assignments?user.id=7618a60dcea6435780f1536aeed614f6&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:21.744451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36074730-9492-4444-a6a2-2f7144100d1a None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:21.745457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36074730-9492-4444-a6a2-2f7144100d1a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:21.745989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36074730-9492-4444-a6a2-2f7144100d1a None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:21.747560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 154/295] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:21.753023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb806-ed9e-48ce-aa6b-1ce3f9ac4720 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:21.753856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb806-ed9e-48ce-aa6b-1ce3f9ac4720 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:21.754342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeeb806-ed9e-48ce-aa6b-1ce3f9ac4720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:21.765772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9c372-8b2b-46be-bebd-bcc2eadd1b0c None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:21.766067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9c372-8b2b-46be-bebd-bcc2eadd1b0c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:21.766337 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9c372-8b2b-46be-bebd-bcc2eadd1b0c None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:21.767691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 155/296] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:21.773463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45714313-6327-4a9f-a1e6-262e85385f3c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:21.773675 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ffeeb806-ed9e-48ce-aa6b-1ce3f9ac4720 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:21.773813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45714313-6327-4a9f-a1e6-262e85385f3c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:21.774058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45714313-6327-4a9f-a1e6-262e85385f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:21.775713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ffeeb806-ed9e-48ce-aa6b-1ce3f9ac4720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:21.793103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-45714313-6327-4a9f-a1e6-262e85385f3c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:21.794836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-45714313-6327-4a9f-a1e6-262e85385f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:21.862144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 142/297] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:21.863898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db57ce-f709-4a72-b4fc-fc89d77f6bd3 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:21.865299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db57ce-f709-4a72-b4fc-fc89d77f6bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:21.865759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db57ce-f709-4a72-b4fc-fc89d77f6bd3 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:21.867459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 143/298] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:21.873129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de5696-0ade-44e5-a951-6404a1ef2724 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:21.873426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de5696-0ade-44e5-a951-6404a1ef2724 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:21.873710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de5696-0ade-44e5-a951-6404a1ef2724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:21.887758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 156/299] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:21.892917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45714313-6327-4a9f-a1e6-262e85385f3c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:21.899309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-55de5696-0ade-44e5-a951-6404a1ef2724 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:21.900734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-55de5696-0ade-44e5-a951-6404a1ef2724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:21.969366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:21.979368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 144/300] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:21.979368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de5696-0ade-44e5-a951-6404a1ef2724 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:21.992271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:21.995587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45714313-6327-4a9f-a1e6-262e85385f3c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:22.041059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d67a-51a3-446f-86eb-9b1ace35d998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:22.041867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d67a-51a3-446f-86eb-9b1ace35d998 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.042152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d67a-51a3-446f-86eb-9b1ace35d998 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.042430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d67a-51a3-446f-86eb-9b1ace35d998 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.053355 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2d67a-51a3-446f-86eb-9b1ace35d998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-29c2d67a-51a3-446f-86eb-9b1ace35d998 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:22.061093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:22.061964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:22.062751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:22.067091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 157/301] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:22.068669 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d67a-51a3-446f-86eb-9b1ace35d998 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:22.088854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de5696-0ade-44e5-a951-6404a1ef2724 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:22.127882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a8585-d3e8-4af5-8b2c-faba9163a343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:22.128701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a8585-d3e8-4af5-8b2c-faba9163a343 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.128984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a8585-d3e8-4af5-8b2c-faba9163a343 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.129259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a8585-d3e8-4af5-8b2c-faba9163a343 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.141552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a8585-d3e8-4af5-8b2c-faba9163a343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-b30a8585-d3e8-4af5-8b2c-faba9163a343 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:22.149876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:22.150798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:22.151584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 145/302] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:22.152288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a8585-d3e8-4af5-8b2c-faba9163a343 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:22.184947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d67a-51a3-446f-86eb-9b1ace35d998 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:22.222482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26872b7-62d0-4d1a-bb04-e0d7aa140e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:22.223026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:22.223890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26872b7-62d0-4d1a-bb04-e0d7aa140e18 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.224210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26872b7-62d0-4d1a-bb04-e0d7aa140e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.224485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26872b7-62d0-4d1a-bb04-e0d7aa140e18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.225725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26872b7-62d0-4d1a-bb04-e0d7aa140e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:22.227370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26872b7-62d0-4d1a-bb04-e0d7aa140e18 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:22.233574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 158/303] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:22.233574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26872b7-62d0-4d1a-bb04-e0d7aa140e18 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:22.233574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:22.263053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a8585-d3e8-4af5-8b2c-faba9163a343 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:22.296195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec176fe8-7975-4170-8d25-5a4f74ead1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:22.296870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176fe8-7975-4170-8d25-5a4f74ead1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.297158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176fe8-7975-4170-8d25-5a4f74ead1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.297444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176fe8-7975-4170-8d25-5a4f74ead1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.298196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec176fe8-7975-4170-8d25-5a4f74ead1d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:22.298509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec176fe8-7975-4170-8d25-5a4f74ead1d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:22.300219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec176fe8-7975-4170-8d25-5a4f74ead1d3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:22.309377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 146/304] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:22.310210 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec176fe8-7975-4170-8d25-5a4f74ead1d3 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:22.343516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26872b7-62d0-4d1a-bb04-e0d7aa140e18 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:22.380602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964c53c-7095-4c01-b3d8-845b9509985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:22.381645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964c53c-7095-4c01-b3d8-845b9509985a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.382200 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964c53c-7095-4c01-b3d8-845b9509985a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.382479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964c53c-7095-4c01-b3d8-845b9509985a None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.383237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964c53c-7095-4c01-b3d8-845b9509985a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:22.383552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964c53c-7095-4c01-b3d8-845b9509985a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:22.385015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964c53c-7095-4c01-b3d8-845b9509985a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:22.393884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 159/305] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:22.394671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964c53c-7095-4c01-b3d8-845b9509985a None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:22.418714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec176fe8-7975-4170-8d25-5a4f74ead1d3 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:22.446841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:22.452914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca06aff-bec3-43ad-9dfc-368580e8ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:22.453589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca06aff-bec3-43ad-9dfc-368580e8ce44 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.453872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca06aff-bec3-43ad-9dfc-368580e8ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.454147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca06aff-bec3-43ad-9dfc-368580e8ce44 None admin] PATH_INFO: `/v3/groups` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.454845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca06aff-bec3-43ad-9dfc-368580e8ce44 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:22.455753 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:22.456697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca06aff-bec3-43ad-9dfc-368580e8ce44 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:22.471119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 147/306] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Jun 16 00:11:22 2022] POST /identity/v3/groups => generated 229 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:11:22.472536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea46e30-c8a6-4355-9de3-912733b2fd6c None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.472829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea46e30-c8a6-4355-9de3-912733b2fd6c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.473107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea46e30-c8a6-4355-9de3-912733b2fd6c None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.474883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 148/307] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:22.475606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea46e30-c8a6-4355-9de3-912733b2fd6c None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:22.502865 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964c53c-7095-4c01-b3d8-845b9509985a None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:22.540450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b376f-062e-4a98-a934-1a32bba56e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:22.541267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b376f-062e-4a98-a934-1a32bba56e81 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.541557 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b376f-062e-4a98-a934-1a32bba56e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.541837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b376f-062e-4a98-a934-1a32bba56e81 None admin] PATH_INFO: `/v3/users/fd8fb1d3c0494785a5ef83a2141e4599` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.543141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b376f-062e-4a98-a934-1a32bba56e81 None admin] RBAC: Authorizing `identity:get_user(user_id=fd8fb1d3c0494785a5ef83a2141e4599)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:22.544658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b376f-062e-4a98-a934-1a32bba56e81 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:22.546367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 160/308] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:22 2022] GET /identity/v3/users/fd8fb1d3c0494785a5ef83a2141e4599 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:22.547616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260cb0-cb6c-4e9f-853b-9a44e828c279 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.547907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260cb0-cb6c-4e9f-853b-9a44e828c279 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.548218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260cb0-cb6c-4e9f-853b-9a44e828c279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.566601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-6b260cb0-cb6c-4e9f-853b-9a44e828c279 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:22.567888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6b260cb0-cb6c-4e9f-853b-9a44e828c279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:22.616729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea46e30-c8a6-4355-9de3-912733b2fd6c None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:22.655986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 161/309] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:22.655986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b260cb0-cb6c-4e9f-853b-9a44e828c279 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:22.666599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a5a8c-f283-4b59-ba77-2534517ecf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:22.667591 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a5a8c-f283-4b59-ba77-2534517ecf0c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.667945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a5a8c-f283-4b59-ba77-2534517ecf0c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.668899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a5a8c-f283-4b59-ba77-2534517ecf0c None admin] PATH_INFO: `/v3/users/53e38c33537540a5a269f742bc1af0e2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.687405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a5a8c-f283-4b59-ba77-2534517ecf0c None admin] RBAC: Authorizing `identity:get_user(user_id=53e38c33537540a5a269f742bc1af0e2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:22.689147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a5a8c-f283-4b59-ba77-2534517ecf0c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:22.690936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 149/310] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:22 2022] GET /identity/v3/users/53e38c33537540a5a269f742bc1af0e2 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:22.691780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a5a8c-f283-4b59-ba77-2534517ecf0c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:22.721038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:22.747756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:22.764452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b260cb0-cb6c-4e9f-853b-9a44e828c279 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:22.801832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce41d5c-2715-45d6-905b-004889e836d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:22.802616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce41d5c-2715-45d6-905b-004889e836d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.802903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce41d5c-2715-45d6-905b-004889e836d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.803184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce41d5c-2715-45d6-905b-004889e836d7 None admin] PATH_INFO: `/v3/system/users/fd8fb1d3c0494785a5ef83a2141e4599/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.804704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce41d5c-2715-45d6-905b-004889e836d7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fd8fb1d3c0494785a5ef83a2141e4599, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:22.806104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce41d5c-2715-45d6-905b-004889e836d7 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:22.809197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a5a8c-f283-4b59-ba77-2534517ecf0c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:22.817840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 162/311] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Jun 16 00:11:22 2022] PUT /identity/v3/system/users/fd8fb1d3c0494785a5ef83a2141e4599/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:22.819064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce41d5c-2715-45d6-905b-004889e836d7 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:22.854773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3c0b2-683f-467a-9551-526e80543662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:22.855593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c0b2-683f-467a-9551-526e80543662 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:22.855881 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c0b2-683f-467a-9551-526e80543662 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:22.856210 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3c0b2-683f-467a-9551-526e80543662 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:22.868434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3c0b2-683f-467a-9551-526e80543662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-b6a3c0b2-683f-467a-9551-526e80543662 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:22.876548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:22.877525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:22.884063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 150/312] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:22.886555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3c0b2-683f-467a-9551-526e80543662 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:22.962596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce41d5c-2715-45d6-905b-004889e836d7 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:22.996573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:23.011549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41806468-d4f1-44b7-8741-5aadf41aec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:23.012247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41806468-d4f1-44b7-8741-5aadf41aec83 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:23.012533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41806468-d4f1-44b7-8741-5aadf41aec83 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:23.013380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41806468-d4f1-44b7-8741-5aadf41aec83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:23.013646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41806468-d4f1-44b7-8741-5aadf41aec83 None admin] RBAC: Adding query filter params (role.id=725793cd452f4a0b9bcacc1754592b62, user.id=53e38c33537540a5a269f742bc1af0e2, scope.system=all) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:23.013970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41806468-d4f1-44b7-8741-5aadf41aec83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:23.015559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41806468-d4f1-44b7-8741-5aadf41aec83 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:23.023029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3c0b2-683f-467a-9551-526e80543662 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:23.023173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 163/313] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jun 16 00:11:22 2022] GET /identity/v3/role_assignments?user.id=53e38c33537540a5a269f742bc1af0e2&scope.system=all&role.id=725793cd452f4a0b9bcacc1754592b62 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:23.034728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:23.065041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ceab3f-ff7d-46a2-b90d-2963e20edda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:23.065651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ceab3f-ff7d-46a2-b90d-2963e20edda4 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:23.067994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ceab3f-ff7d-46a2-b90d-2963e20edda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:23.067994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ceab3f-ff7d-46a2-b90d-2963e20edda4 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:23.067994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ceab3f-ff7d-46a2-b90d-2963e20edda4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:23.067994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ceab3f-ff7d-46a2-b90d-2963e20edda4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:23.069273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ceab3f-ff7d-46a2-b90d-2963e20edda4 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:23.079497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 151/314] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:23.085651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41806468-d4f1-44b7-8741-5aadf41aec83 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:23.193591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41806468-d4f1-44b7-8741-5aadf41aec83 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:23.234940 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1403f-cbe8-46d4-8bbf-8d0b037f3baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:23.235826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1403f-cbe8-46d4-8bbf-8d0b037f3baf None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:23.236179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1403f-cbe8-46d4-8bbf-8d0b037f3baf None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:23.236457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1403f-cbe8-46d4-8bbf-8d0b037f3baf None admin] PATH_INFO: `/v3/users/082e60f9378147c3b80f8301f3b894a5` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:23.237666 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1403f-cbe8-46d4-8bbf-8d0b037f3baf None admin] RBAC: Authorizing `identity:get_user(user_id=082e60f9378147c3b80f8301f3b894a5)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:23.239715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1403f-cbe8-46d4-8bbf-8d0b037f3baf None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:23.246111 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 164/315] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:23 2022] GET /identity/v3/users/082e60f9378147c3b80f8301f3b894a5 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:23.247468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ceab3f-ff7d-46a2-b90d-2963e20edda4 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:23.357895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ceab3f-ff7d-46a2-b90d-2963e20edda4 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:23.392038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979caf70-38df-4ce5-8523-d4c5ff151663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:23.392693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979caf70-38df-4ce5-8523-d4c5ff151663 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:23.392978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979caf70-38df-4ce5-8523-d4c5ff151663 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:23.393259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979caf70-38df-4ce5-8523-d4c5ff151663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:23.440789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:23.464284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979caf70-38df-4ce5-8523-d4c5ff151663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:23.465845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979caf70-38df-4ce5-8523-d4c5ff151663 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:23.567858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 152/316] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:23.573274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1403f-cbe8-46d4-8bbf-8d0b037f3baf None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:23.636001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:23.679411 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1403f-cbe8-46d4-8bbf-8d0b037f3baf None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:23.715470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733277e8-61c8-495f-bc65-fea7018990ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:23.716986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733277e8-61c8-495f-bc65-fea7018990ae None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:23.717502 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733277e8-61c8-495f-bc65-fea7018990ae None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:23.717981 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733277e8-61c8-495f-bc65-fea7018990ae None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:23.719389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733277e8-61c8-495f-bc65-fea7018990ae None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:23.721052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733277e8-61c8-495f-bc65-fea7018990ae None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:23.723377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 165/317] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:23 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:23.729074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979caf70-38df-4ce5-8523-d4c5ff151663 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:23.800334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:23.831941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979caf70-38df-4ce5-8523-d4c5ff151663 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:23.867098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a0e96-00fd-4b03-8391-83d3cd37b675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:23.867755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0e96-00fd-4b03-8391-83d3cd37b675 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:23.868070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0e96-00fd-4b03-8391-83d3cd37b675 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:23.868349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0e96-00fd-4b03-8391-83d3cd37b675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:23.869177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a0e96-00fd-4b03-8391-83d3cd37b675 None admin] RBAC: Adding query filter params (role.id=725793cd452f4a0b9bcacc1754592b62, scope.project.id=75585a6ed1724a4199c43e9f777fe503, user.id=082e60f9378147c3b80f8301f3b894a5) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:23.869493 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a0e96-00fd-4b03-8391-83d3cd37b675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:23.871037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a0e96-00fd-4b03-8391-83d3cd37b675 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:23.877254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 153/318] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:23 2022] GET /identity/v3/role_assignments?user.id=082e60f9378147c3b80f8301f3b894a5&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=725793cd452f4a0b9bcacc1754592b62 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:24.616955 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9737c-bac1-4181-a642-b873e30a24ce None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:24.617472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9737c-bac1-4181-a642-b873e30a24ce None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:24.617545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9737c-bac1-4181-a642-b873e30a24ce None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:24.619000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 166/319] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:24.623880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5bad0-61d8-4ed1-b9a0-ea578c677270 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:24.624216 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5bad0-61d8-4ed1-b9a0-ea578c677270 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:24.624497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5bad0-61d8-4ed1-b9a0-ea578c677270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:24.641588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-dfa5bad0-61d8-4ed1-b9a0-ea578c677270 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:24.642744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-dfa5bad0-61d8-4ed1-b9a0-ea578c677270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:24.710386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 154/320] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:24.732350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9737c-bac1-4181-a642-b873e30a24ce None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:24.834244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9737c-bac1-4181-a642-b873e30a24ce None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:24.859227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:24.869919 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f32c3f-28b6-4019-929b-361cda787f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:24.870656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32c3f-28b6-4019-929b-361cda787f8c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:24.870944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32c3f-28b6-4019-929b-361cda787f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:24.871225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f32c3f-28b6-4019-929b-361cda787f8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:24.872465 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f32c3f-28b6-4019-929b-361cda787f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:24.873920 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f32c3f-28b6-4019-929b-361cda787f8c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:24.875693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 167/321] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:24.881585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5bad0-61d8-4ed1-b9a0-ea578c677270 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:24.943019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:24.981319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5bad0-61d8-4ed1-b9a0-ea578c677270 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:25.024713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3d7c0-5528-4e82-9a98-22288c9ccd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:25.025416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d7c0-5528-4e82-9a98-22288c9ccd6e None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:25.025703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d7c0-5528-4e82-9a98-22288c9ccd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:25.025981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d7c0-5528-4e82-9a98-22288c9ccd6e None admin] PATH_INFO: `/v3/groups` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:25.026705 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3d7c0-5528-4e82-9a98-22288c9ccd6e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:25.028248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3d7c0-5528-4e82-9a98-22288c9ccd6e None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:25.045578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 155/322] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Jun 16 00:11:24 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:11:25.078784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979c44-6694-41bb-a2c9-836e704e1545 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:25.079211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979c44-6694-41bb-a2c9-836e704e1545 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:25.079704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979c44-6694-41bb-a2c9-836e704e1545 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:25.081292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 168/323] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:25.087139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af93bd-670f-440c-9700-587cada54157 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:25.087424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af93bd-670f-440c-9700-587cada54157 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:25.087704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af93bd-670f-440c-9700-587cada54157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:25.105526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f6af93bd-670f-440c-9700-587cada54157 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:25.106756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f6af93bd-670f-440c-9700-587cada54157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:25.181530 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 156/324] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:25.205190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25979c44-6694-41bb-a2c9-836e704e1545 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:25.276993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1341fb-fa39-4b35-93c2-da87df0b32cc None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:25.277305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1341fb-fa39-4b35-93c2-da87df0b32cc None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:25.277560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1341fb-fa39-4b35-93c2-da87df0b32cc None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:25.278945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 157/325] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:25.286197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7359d-5341-4391-8156-708733a715c7 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:25.286502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7359d-5341-4391-8156-708733a715c7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:25.286848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7359d-5341-4391-8156-708733a715c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:25.306984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-08e7359d-5341-4391-8156-708733a715c7 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:25.308416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-08e7359d-5341-4391-8156-708733a715c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:25.325135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25979c44-6694-41bb-a2c9-836e704e1545 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:25.367080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509782f-ad04-4803-9881-5b5447654985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:25.368621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509782f-ad04-4803-9881-5b5447654985 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:25.369301 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509782f-ad04-4803-9881-5b5447654985 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:25.369802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509782f-ad04-4803-9881-5b5447654985 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:25.370582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:25.386273 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509782f-ad04-4803-9881-5b5447654985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:25.393280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 158/326] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-3509782f-ad04-4803-9881-5b5447654985 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:25.396526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:25.397392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:25.398184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 169/327] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:25.404004 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509782f-ad04-4803-9881-5b5447654985 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:25.420051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7359d-5341-4391-8156-708733a715c7 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:25.478679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:25.538890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509782f-ad04-4803-9881-5b5447654985 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:25.549034 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7359d-5341-4391-8156-708733a715c7 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:25.578300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc8ea2-5dc1-4870-9a62-6459b0d2ad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:25.578989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc8ea2-5dc1-4870-9a62-6459b0d2ad0f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:25.579657 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc8ea2-5dc1-4870-9a62-6459b0d2ad0f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:25.580098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc8ea2-5dc1-4870-9a62-6459b0d2ad0f None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:25.581126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc8ea2-5dc1-4870-9a62-6459b0d2ad0f None admin] RBAC: Adding query filter params (name=member) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:25.581596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc8ea2-5dc1-4870-9a62-6459b0d2ad0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:25.584132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc8ea2-5dc1-4870-9a62-6459b0d2ad0f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:25.591662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fee00c-e7b8-4810-b93e-94fc6423689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:25.592775 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fee00c-e7b8-4810-b93e-94fc6423689e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:25.593066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fee00c-e7b8-4810-b93e-94fc6423689e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:25.593341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fee00c-e7b8-4810-b93e-94fc6423689e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:25.593840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 170/328] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:25.599777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc8ea2-5dc1-4870-9a62-6459b0d2ad0f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:25.610685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fee00c-e7b8-4810-b93e-94fc6423689e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-92fee00c-e7b8-4810-b93e-94fc6423689e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:25.625026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:25.625933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:25.626715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:25.627804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 159/329] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:25.634640 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fee00c-e7b8-4810-b93e-94fc6423689e None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:25.700751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:25.762090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc8ea2-5dc1-4870-9a62-6459b0d2ad0f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:25.785274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fee00c-e7b8-4810-b93e-94fc6423689e None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:25.786837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:25.823934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124fcf8-63b0-4369-8381-1ff985a82b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:25.825268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124fcf8-63b0-4369-8381-1ff985a82b49 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:25.825822 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124fcf8-63b0-4369-8381-1ff985a82b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:25.826207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124fcf8-63b0-4369-8381-1ff985a82b49 None admin] PATH_INFO: `/v3/users/fd8fb1d3c0494785a5ef83a2141e4599` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:25.828089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124fcf8-63b0-4369-8381-1ff985a82b49 None admin] RBAC: Authorizing `identity:get_user(user_id=fd8fb1d3c0494785a5ef83a2141e4599)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:25.829574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124fcf8-63b0-4369-8381-1ff985a82b49 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:25.831245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 171/330] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:25 2022] GET /identity/v3/users/fd8fb1d3c0494785a5ef83a2141e4599 => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:25.831607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4cfdf-9a6f-4b5b-a5f5-7615cf3734cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:25.832950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4cfdf-9a6f-4b5b-a5f5-7615cf3734cf None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:25.832950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4cfdf-9a6f-4b5b-a5f5-7615cf3734cf None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:25.833120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4cfdf-9a6f-4b5b-a5f5-7615cf3734cf None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:25.834059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4cfdf-9a6f-4b5b-a5f5-7615cf3734cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:25.834376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4cfdf-9a6f-4b5b-a5f5-7615cf3734cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:25.835781 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4cfdf-9a6f-4b5b-a5f5-7615cf3734cf None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:25.841482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124fcf8-63b0-4369-8381-1ff985a82b49 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:25.854707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 160/331] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:25.857234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4cfdf-9a6f-4b5b-a5f5-7615cf3734cf None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:25.984318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4cfdf-9a6f-4b5b-a5f5-7615cf3734cf None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:25.986426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124fcf8-63b0-4369-8381-1ff985a82b49 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:25.996303 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:26.028060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd05e9b-a3c4-41fd-bcb4-2fc0a0c6a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:26.028214 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999f528-584b-441d-97e7-acfe35b6e92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:26.028327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd05e9b-a3c4-41fd-bcb4-2fc0a0c6a70a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:26.028402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999f528-584b-441d-97e7-acfe35b6e92f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:26.028402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999f528-584b-441d-97e7-acfe35b6e92f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:26.028521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd05e9b-a3c4-41fd-bcb4-2fc0a0c6a70a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:26.028595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999f528-584b-441d-97e7-acfe35b6e92f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:26.028670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd05e9b-a3c4-41fd-bcb4-2fc0a0c6a70a None admin] PATH_INFO: `/v3/users/53e38c33537540a5a269f742bc1af0e2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:26.028737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999f528-584b-441d-97e7-acfe35b6e92f None admin] RBAC: Adding query filter params (role.id=531d1ead7d164c708ad131b14d2f9301, user.id=fd8fb1d3c0494785a5ef83a2141e4599, scope.system=all) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:26.028925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999f528-584b-441d-97e7-acfe35b6e92f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:26.029880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd05e9b-a3c4-41fd-bcb4-2fc0a0c6a70a None admin] RBAC: Authorizing `identity:get_user(user_id=53e38c33537540a5a269f742bc1af0e2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:26.032604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999f528-584b-441d-97e7-acfe35b6e92f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:26.032737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd05e9b-a3c4-41fd-bcb4-2fc0a0c6a70a None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:26.032960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 161/332] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:25 2022] GET /identity/v3/users/53e38c33537540a5a269f742bc1af0e2 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:26.041043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd05e9b-a3c4-41fd-bcb4-2fc0a0c6a70a None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:26.066008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 172/333] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jun 16 00:11:25 2022] GET /identity/v3/role_assignments?user.id=fd8fb1d3c0494785a5ef83a2141e4599&scope.system=all&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:26.185608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd05e9b-a3c4-41fd-bcb4-2fc0a0c6a70a None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:26.237971 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95014545-919a-48be-897a-d3aee5cebe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:26.239685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95014545-919a-48be-897a-d3aee5cebe19 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:26.240147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95014545-919a-48be-897a-d3aee5cebe19 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:26.240577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95014545-919a-48be-897a-d3aee5cebe19 None admin] PATH_INFO: `/v3/system/users/53e38c33537540a5a269f742bc1af0e2/roles/725793cd452f4a0b9bcacc1754592b62` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:26.244889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95014545-919a-48be-897a-d3aee5cebe19 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=53e38c33537540a5a269f742bc1af0e2, role_id=725793cd452f4a0b9bcacc1754592b62)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:26.246662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95014545-919a-48be-897a-d3aee5cebe19 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:26.261383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 162/334] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Jun 16 00:11:26 2022] PUT /identity/v3/system/users/53e38c33537540a5a269f742bc1af0e2/roles/725793cd452f4a0b9bcacc1754592b62 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:27.610194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7008e-c76c-4fc4-b54a-63469e26215b None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:27.611210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7008e-c76c-4fc4-b54a-63469e26215b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:27.611717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7008e-c76c-4fc4-b54a-63469e26215b None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:27.613553 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 173/335] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:27.620613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244938e-9501-4998-b8d8-628028e761fa None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:27.621431 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244938e-9501-4998-b8d8-628028e761fa None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:27.621906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244938e-9501-4998-b8d8-628028e761fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:27.641472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6244938e-9501-4998-b8d8-628028e761fa None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:27.642976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6244938e-9501-4998-b8d8-628028e761fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:27.677010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:27.730008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 163/336] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:27.752794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7008e-c76c-4fc4-b54a-63469e26215b None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:27.808243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:27.869896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7008e-c76c-4fc4-b54a-63469e26215b None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:27.905091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5acbe-8fe3-427a-b4f9-f67af3c53905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:27.906230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5acbe-8fe3-427a-b4f9-f67af3c53905 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:27.906734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5acbe-8fe3-427a-b4f9-f67af3c53905 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:27.907204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5acbe-8fe3-427a-b4f9-f67af3c53905 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:27.918092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5acbe-8fe3-427a-b4f9-f67af3c53905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-b2d5acbe-8fe3-427a-b4f9-f67af3c53905 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:27.926947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:27.927809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:27.928631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:27.935721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 174/337] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:27.937288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244938e-9501-4998-b8d8-628028e761fa None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:28.060283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244938e-9501-4998-b8d8-628028e761fa None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:28.100927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12650254-04dc-45ac-b703-9208545a4929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:28.101603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650254-04dc-45ac-b703-9208545a4929 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:28.101885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650254-04dc-45ac-b703-9208545a4929 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:28.102158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12650254-04dc-45ac-b703-9208545a4929 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:28.102913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12650254-04dc-45ac-b703-9208545a4929 None admin] RBAC: Adding query filter params (name=member) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:28.103219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12650254-04dc-45ac-b703-9208545a4929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:28.104747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12650254-04dc-45ac-b703-9208545a4929 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:28.115157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 164/338] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:28.120671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5acbe-8fe3-427a-b4f9-f67af3c53905 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:28.267399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5acbe-8fe3-427a-b4f9-f67af3c53905 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:28.268992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:28.305915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2d2ac-7089-4196-b0aa-c432b61790ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:28.306700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2d2ac-7089-4196-b0aa-c432b61790ea None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:28.306989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2d2ac-7089-4196-b0aa-c432b61790ea None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:28.307268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2d2ac-7089-4196-b0aa-c432b61790ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:28.382968 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2d2ac-7089-4196-b0aa-c432b61790ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:28.384385 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2d2ac-7089-4196-b0aa-c432b61790ea None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:28.494872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 175/339] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:28.497065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12650254-04dc-45ac-b703-9208545a4929 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:28.533879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a03de9-1513-43eb-a147-c22ee7ae65c2 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:28.534475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a03de9-1513-43eb-a147-c22ee7ae65c2 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:28.534900 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a03de9-1513-43eb-a147-c22ee7ae65c2 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:28.536593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 176/340] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:11:28.542631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746ef89-7c34-4c3a-8c7c-8f81ce777309 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:28.543102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746ef89-7c34-4c3a-8c7c-8f81ce777309 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:28.543520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746ef89-7c34-4c3a-8c7c-8f81ce777309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:28.559171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:28.568688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:28.580706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e746ef89-7c34-4c3a-8c7c-8f81ce777309 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:28.581953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e746ef89-7c34-4c3a-8c7c-8f81ce777309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:28.683042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12650254-04dc-45ac-b703-9208545a4929 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:28.695804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 177/341] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:28.714342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36766a3-aab1-43a6-93dc-52baf5f71bba None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:28.714858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36766a3-aab1-43a6-93dc-52baf5f71bba None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:28.715282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36766a3-aab1-43a6-93dc-52baf5f71bba None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:28.717573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 178/342] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:28.722953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15088f-5e48-40c9-9915-105563da93cd None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:28.723495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15088f-5e48-40c9-9915-105563da93cd None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:28.723919 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15088f-5e48-40c9-9915-105563da93cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:28.747368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ad15088f-5e48-40c9-9915-105563da93cd None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:28.750565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ad15088f-5e48-40c9-9915-105563da93cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:28.761988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420c1af-4d3e-43e1-8ada-6b96ee4149da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:28.762864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420c1af-4d3e-43e1-8ada-6b96ee4149da None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:28.763145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420c1af-4d3e-43e1-8ada-6b96ee4149da None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:28.763420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420c1af-4d3e-43e1-8ada-6b96ee4149da None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:28.766325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420c1af-4d3e-43e1-8ada-6b96ee4149da None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:28.767786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420c1af-4d3e-43e1-8ada-6b96ee4149da None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:28.769842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 165/343] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:28 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:28.770668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420c1af-4d3e-43e1-8ada-6b96ee4149da None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:28.900014 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:28.906093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420c1af-4d3e-43e1-8ada-6b96ee4149da None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:28.914570 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 179/344] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:28.915445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15088f-5e48-40c9-9915-105563da93cd None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:28.959149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6121cf8-4668-4803-9b00-3ea0eba1cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:28.960220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6121cf8-4668-4803-9b00-3ea0eba1cf35 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:28.960645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6121cf8-4668-4803-9b00-3ea0eba1cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:28.961097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6121cf8-4668-4803-9b00-3ea0eba1cf35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:28.978372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6121cf8-4668-4803-9b00-3ea0eba1cf35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-c6121cf8-4668-4803-9b00-3ea0eba1cf35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:28.989750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:28.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:28.991831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:28.996314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 166/345] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:11:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:28.997316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6121cf8-4668-4803-9b00-3ea0eba1cf35 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:29.023747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:29.073882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15088f-5e48-40c9-9915-105563da93cd None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:29.143155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0529e-b28e-4b78-9c73-b65dc5ea1ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:29.144059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0529e-b28e-4b78-9c73-b65dc5ea1ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:29.144351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0529e-b28e-4b78-9c73-b65dc5ea1ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:29.144632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0529e-b28e-4b78-9c73-b65dc5ea1ca9 None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:29.154857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0529e-b28e-4b78-9c73-b65dc5ea1ca9 None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:29.156356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0529e-b28e-4b78-9c73-b65dc5ea1ca9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:29.158935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 180/346] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:28 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:29.160362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0529e-b28e-4b78-9c73-b65dc5ea1ca9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:29.166007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6121cf8-4668-4803-9b00-3ea0eba1cf35 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:29.233369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa17b3-526a-413c-8fbf-6a6ad1d52f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:29.234853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa17b3-526a-413c-8fbf-6a6ad1d52f63 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:29.235297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa17b3-526a-413c-8fbf-6a6ad1d52f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:29.235846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa17b3-526a-413c-8fbf-6a6ad1d52f63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:29.250821 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa17b3-526a-413c-8fbf-6a6ad1d52f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-81fa17b3-526a-413c-8fbf-6a6ad1d52f63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:29.259057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:29.260058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:29.260892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 167/347] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:29.261549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa17b3-526a-413c-8fbf-6a6ad1d52f63 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:29.285286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:29.345178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0529e-b28e-4b78-9c73-b65dc5ea1ca9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:29.375569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:29.384651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa17b3-526a-413c-8fbf-6a6ad1d52f63 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:29.385662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4c841-a269-4f13-9fe4-b4b1abd4aa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:29.386446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4c841-a269-4f13-9fe4-b4b1abd4aa5b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:29.386768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4c841-a269-4f13-9fe4-b4b1abd4aa5b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:29.387112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4c841-a269-4f13-9fe4-b4b1abd4aa5b None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:29.387875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4c841-a269-4f13-9fe4-b4b1abd4aa5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:29.388243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4c841-a269-4f13-9fe4-b4b1abd4aa5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:29.392341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4c841-a269-4f13-9fe4-b4b1abd4aa5b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:29.402382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 181/348] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:29.403614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3e4a-de6c-4084-8de6-84c47b6057f3 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:29.403908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3e4a-de6c-4084-8de6-84c47b6057f3 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:29.405373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3e4a-de6c-4084-8de6-84c47b6057f3 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:29.406881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 182/349] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:29.407744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3e4a-de6c-4084-8de6-84c47b6057f3 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:29.422211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d62f-7554-494c-9ba9-7493e8d268f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:29.422945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d62f-7554-494c-9ba9-7493e8d268f2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:29.423235 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d62f-7554-494c-9ba9-7493e8d268f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:29.423511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d62f-7554-494c-9ba9-7493e8d268f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:29.424380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d62f-7554-494c-9ba9-7493e8d268f2 None admin] RBAC: Adding query filter params (group.id=53f493090c0c4a74b050811995b3a9de, role.id=531d1ead7d164c708ad131b14d2f9301, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:29.424751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d62f-7554-494c-9ba9-7493e8d268f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:29.426305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d62f-7554-494c-9ba9-7493e8d268f2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:29.436114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 168/350] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 16 00:11:29 2022] GET /identity/v3/role_assignments?group.id=53f493090c0c4a74b050811995b3a9de&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:29.437111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d62f-7554-494c-9ba9-7493e8d268f2 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:29.551724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3e4a-de6c-4084-8de6-84c47b6057f3 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:29.581968 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:29.618211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d62f-7554-494c-9ba9-7493e8d268f2 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:29.628185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dd0ce-c18d-419b-9cea-2e011dd147b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:29.629189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd0ce-c18d-419b-9cea-2e011dd147b4 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:29.630204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd0ce-c18d-419b-9cea-2e011dd147b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:29.630686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dd0ce-c18d-419b-9cea-2e011dd147b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:29.631637 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dd0ce-c18d-419b-9cea-2e011dd147b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:29.632155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dd0ce-c18d-419b-9cea-2e011dd147b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:29.633757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dd0ce-c18d-419b-9cea-2e011dd147b4 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:29.649847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 183/351] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:29.651587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4e50b-973e-4780-b305-4cc8cf87c58d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:29.652978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4e50b-973e-4780-b305-4cc8cf87c58d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:29.653620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4e50b-973e-4780-b305-4cc8cf87c58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:29.685086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-82c4e50b-973e-4780-b305-4cc8cf87c58d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:29.686005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b36f17-10cc-4128-8f35-c6faca6f8dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:29.686483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-82c4e50b-973e-4780-b305-4cc8cf87c58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:29.687332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b36f17-10cc-4128-8f35-c6faca6f8dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:29.687805 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b36f17-10cc-4128-8f35-c6faca6f8dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:29.688282 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b36f17-10cc-4128-8f35-c6faca6f8dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:29.775993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:29.790693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b36f17-10cc-4128-8f35-c6faca6f8dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:29.792386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b36f17-10cc-4128-8f35-c6faca6f8dc8 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:29.841362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 184/352] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:29.842618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4e50b-973e-4780-b305-4cc8cf87c58d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:29.897153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:29.906732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 169/353] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:29.907697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b36f17-10cc-4128-8f35-c6faca6f8dc8 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:29.998963 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4e50b-973e-4780-b305-4cc8cf87c58d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:30.018614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b36f17-10cc-4128-8f35-c6faca6f8dc8 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:30.036628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf28b5d-b364-45e3-9a22-c4f32d1d36c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:30.037433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf28b5d-b364-45e3-9a22-c4f32d1d36c2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.037722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf28b5d-b364-45e3-9a22-c4f32d1d36c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.038002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf28b5d-b364-45e3-9a22-c4f32d1d36c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.054696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ab67c-1f49-46d9-a73d-6ae3287f7b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:30.055524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ab67c-1f49-46d9-a73d-6ae3287f7b06 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.055806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ab67c-1f49-46d9-a73d-6ae3287f7b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.056115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ab67c-1f49-46d9-a73d-6ae3287f7b06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.067785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ab67c-1f49-46d9-a73d-6ae3287f7b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-b89ab67c-1f49-46d9-a73d-6ae3287f7b06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:30.077266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:30.078172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:30.078950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 170/354] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:11:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:30.079622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ab67c-1f49-46d9-a73d-6ae3287f7b06 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:30.115056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf28b5d-b364-45e3-9a22-c4f32d1d36c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:30.116778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf28b5d-b364-45e3-9a22-c4f32d1d36c2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:30.120293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:30.137635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:30.209800 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ab67c-1f49-46d9-a73d-6ae3287f7b06 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:30.258633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171df5a-67ca-49b3-916b-40b11beb6c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:30.259516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171df5a-67ca-49b3-916b-40b11beb6c78 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.259796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171df5a-67ca-49b3-916b-40b11beb6c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.260100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171df5a-67ca-49b3-916b-40b11beb6c78 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.260291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 185/355] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:30.262665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171df5a-67ca-49b3-916b-40b11beb6c78 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:30.262786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c7599-d27c-4080-baf8-9c62a409f31f None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.262786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c7599-d27c-4080-baf8-9c62a409f31f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.262786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c7599-d27c-4080-baf8-9c62a409f31f None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.262985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171df5a-67ca-49b3-916b-40b11beb6c78 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:30.263406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 186/356] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:30.265327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 171/357] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:30 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:30.266780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121a88e-b51b-44f2-8f20-b73c43a04d3b None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.267277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121a88e-b51b-44f2-8f20-b73c43a04d3b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.267792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121a88e-b51b-44f2-8f20-b73c43a04d3b None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.268415 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c7599-d27c-4080-baf8-9c62a409f31f None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:30.269734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 172/358] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:30.271513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cdbd6-52e8-434a-b56a-dea442324b69 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.271803 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cdbd6-52e8-434a-b56a-dea442324b69 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.272362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cdbd6-52e8-434a-b56a-dea442324b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.293553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-185cdbd6-52e8-434a-b56a-dea442324b69 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:30.294757 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-185cdbd6-52e8-434a-b56a-dea442324b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:30.375589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:30.383527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 173/359] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:30.384740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cdbd6-52e8-434a-b56a-dea442324b69 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:30.398954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c7599-d27c-4080-baf8-9c62a409f31f None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:30.440943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9be6a3-2a95-47dc-adb3-d531b725f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:30.441442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9be6a3-2a95-47dc-adb3-d531b725f641 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.442271 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9be6a3-2a95-47dc-adb3-d531b725f641 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.442485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:30.442606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9be6a3-2a95-47dc-adb3-d531b725f641 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.443326 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9be6a3-2a95-47dc-adb3-d531b725f641 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:30.444081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9be6a3-2a95-47dc-adb3-d531b725f641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:30.445695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9be6a3-2a95-47dc-adb3-d531b725f641 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:30.454296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 187/360] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:30.460084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9be6a3-2a95-47dc-adb3-d531b725f641 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:30.522847 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cdbd6-52e8-434a-b56a-dea442324b69 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:30.574629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119618b-3d40-4f69-a845-4cd930ac8cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:30.575866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119618b-3d40-4f69-a845-4cd930ac8cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.576380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119618b-3d40-4f69-a845-4cd930ac8cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.576952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119618b-3d40-4f69-a845-4cd930ac8cd9 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.579193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119618b-3d40-4f69-a845-4cd930ac8cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:30.581016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119618b-3d40-4f69-a845-4cd930ac8cd9 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:30.584137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 174/361] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:30 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:30.584493 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9be6a3-2a95-47dc-adb3-d531b725f641 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:30.586536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349385-296a-4274-9c9b-fad890cca4a0 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.587189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349385-296a-4274-9c9b-fad890cca4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.587859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349385-296a-4274-9c9b-fad890cca4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.606713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-5b349385-296a-4274-9c9b-fad890cca4a0 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:30.608358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5b349385-296a-4274-9c9b-fad890cca4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:30.630072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39382f47-8c1d-4c4b-abc6-8e8da9d94760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:30.630867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39382f47-8c1d-4c4b-abc6-8e8da9d94760 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.631149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39382f47-8c1d-4c4b-abc6-8e8da9d94760 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.631420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39382f47-8c1d-4c4b-abc6-8e8da9d94760 None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.633151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39382f47-8c1d-4c4b-abc6-8e8da9d94760 None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:30.634591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39382f47-8c1d-4c4b-abc6-8e8da9d94760 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:30.639556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 188/362] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:30 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:30.640943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39382f47-8c1d-4c4b-abc6-8e8da9d94760 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:30.658265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:30.708022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 175/363] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:30.708022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349385-296a-4274-9c9b-fad890cca4a0 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:30.753304 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:30.780485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39382f47-8c1d-4c4b-abc6-8e8da9d94760 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:30.826825 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f4553-2a9c-4c8b-a701-a708d340c41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:30.827633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4553-2a9c-4c8b-a701-a708d340c41d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.827918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4553-2a9c-4c8b-a701-a708d340c41d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.829547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349385-296a-4274-9c9b-fad890cca4a0 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:30.831245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4553-2a9c-4c8b-a701-a708d340c41d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.845991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f4553-2a9c-4c8b-a701-a708d340c41d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-337f4553-2a9c-4c8b-a701-a708d340c41d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:30.855275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:30.856293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:30.857139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 189/364] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:30.857843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f4553-2a9c-4c8b-a701-a708d340c41d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:30.875726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e816f-02ff-4d12-97be-759fb215b443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:30.876414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e816f-02ff-4d12-97be-759fb215b443 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:30.876698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e816f-02ff-4d12-97be-759fb215b443 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:30.876963 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e816f-02ff-4d12-97be-759fb215b443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:30.969217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:30.974874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e816f-02ff-4d12-97be-759fb215b443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:30.974874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e816f-02ff-4d12-97be-759fb215b443 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:31.011345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f4553-2a9c-4c8b-a701-a708d340c41d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:31.024647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:31.072931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfae4c-e77f-4fc6-b541-3c4439c6ea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:31.073800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfae4c-e77f-4fc6-b541-3c4439c6ea8b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:31.074087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfae4c-e77f-4fc6-b541-3c4439c6ea8b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:31.074363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfae4c-e77f-4fc6-b541-3c4439c6ea8b None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:31.075557 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfae4c-e77f-4fc6-b541-3c4439c6ea8b None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:31.077045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfae4c-e77f-4fc6-b541-3c4439c6ea8b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:31.080119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 190/365] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:30 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:31.081574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfae4c-e77f-4fc6-b541-3c4439c6ea8b None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:31.107529 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 176/366] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:31.109072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e816f-02ff-4d12-97be-759fb215b443 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:31.205026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfae4c-e77f-4fc6-b541-3c4439c6ea8b None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:31.231511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e816f-02ff-4d12-97be-759fb215b443 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:31.254560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe0b5a-6580-4784-950d-36faab5385fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:31.255551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0b5a-6580-4784-950d-36faab5385fd None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:31.255551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0b5a-6580-4784-950d-36faab5385fd None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:31.255753 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe0b5a-6580-4784-950d-36faab5385fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:31.256622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe0b5a-6580-4784-950d-36faab5385fd None admin] RBAC: Adding query filter params (group.id=53f493090c0c4a74b050811995b3a9de, role.id=bad10ed55f6140b882d1fdd6994f1fa8, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:31.256942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe0b5a-6580-4784-950d-36faab5385fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:31.258374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe0b5a-6580-4784-950d-36faab5385fd None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:31.266153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 191/367] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 16 00:11:31 2022] GET /identity/v3/role_assignments?group.id=53f493090c0c4a74b050811995b3a9de&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=bad10ed55f6140b882d1fdd6994f1fa8 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:31.266153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe0b5a-6580-4784-950d-36faab5385fd None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:31.271226 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd670d-e7c3-4db4-8a2b-18e5edd5e876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:31.272550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:31.272735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd670d-e7c3-4db4-8a2b-18e5edd5e876 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:31.273709 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd670d-e7c3-4db4-8a2b-18e5edd5e876 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:31.273822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd670d-e7c3-4db4-8a2b-18e5edd5e876 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:31.287554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:31.292855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd670d-e7c3-4db4-8a2b-18e5edd5e876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-1edd670d-e7c3-4db4-8a2b-18e5edd5e876 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:31.305057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:31.306039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 177/368] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:31.306914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd670d-e7c3-4db4-8a2b-18e5edd5e876 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:31.409157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe0b5a-6580-4784-950d-36faab5385fd None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:31.444923 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd670d-e7c3-4db4-8a2b-18e5edd5e876 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:31.455052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d86e7-5750-4953-a30f-aef51e518fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:31.456108 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d86e7-5750-4953-a30f-aef51e518fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:31.456408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d86e7-5750-4953-a30f-aef51e518fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:31.456689 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d86e7-5750-4953-a30f-aef51e518fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:31.457494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d86e7-5750-4953-a30f-aef51e518fb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:31.457804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d86e7-5750-4953-a30f-aef51e518fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:31.459825 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d86e7-5750-4953-a30f-aef51e518fb7 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:31.471256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 192/369] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:31.472282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d86e7-5750-4953-a30f-aef51e518fb7 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:31.495892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b69fd-693d-4e31-9c08-f04019895b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:31.496927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b69fd-693d-4e31-9c08-f04019895b7d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:31.497412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b69fd-693d-4e31-9c08-f04019895b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:31.497888 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b69fd-693d-4e31-9c08-f04019895b7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:31.498941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b69fd-693d-4e31-9c08-f04019895b7d None admin] RBAC: Adding query filter params (group.id=53f493090c0c4a74b050811995b3a9de, role.id=531d1ead7d164c708ad131b14d2f9301, scope.project.id=75585a6ed1724a4199c43e9f777fe503) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:31.499459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b69fd-693d-4e31-9c08-f04019895b7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:31.501117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b69fd-693d-4e31-9c08-f04019895b7d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:31.508597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 178/370] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 16 00:11:31 2022] GET /identity/v3/role_assignments?group.id=53f493090c0c4a74b050811995b3a9de&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:31.509802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b69fd-693d-4e31-9c08-f04019895b7d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:31.548720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:31.597817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d86e7-5750-4953-a30f-aef51e518fb7 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:31.604396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:31.652072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad37116-34e7-4cac-8d7b-dfa264ca3f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:31.653366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad37116-34e7-4cac-8d7b-dfa264ca3f35 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:31.653858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad37116-34e7-4cac-8d7b-dfa264ca3f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:31.654342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad37116-34e7-4cac-8d7b-dfa264ca3f35 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:31.656695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad37116-34e7-4cac-8d7b-dfa264ca3f35 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:31.658450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad37116-34e7-4cac-8d7b-dfa264ca3f35 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:31.663027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b69fd-693d-4e31-9c08-f04019895b7d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:31.665440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 193/371] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:31 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:31.666588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad37116-34e7-4cac-8d7b-dfa264ca3f35 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:31.726086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be44ef5-d07a-45d4-aaab-9318499924bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:31.728195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be44ef5-d07a-45d4-aaab-9318499924bb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:31.728480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be44ef5-d07a-45d4-aaab-9318499924bb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:31.728810 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be44ef5-d07a-45d4-aaab-9318499924bb None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:31.729594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be44ef5-d07a-45d4-aaab-9318499924bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:31.729940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be44ef5-d07a-45d4-aaab-9318499924bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:31.731368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be44ef5-d07a-45d4-aaab-9318499924bb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:31.754288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 179/372] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:31.755573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be44ef5-d07a-45d4-aaab-9318499924bb None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:31.836685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad37116-34e7-4cac-8d7b-dfa264ca3f35 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:31.870817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:31.881892 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264fed5-3e67-465e-b844-bae10e9ba860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:31.882779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264fed5-3e67-465e-b844-bae10e9ba860 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:31.883122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264fed5-3e67-465e-b844-bae10e9ba860 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:31.883398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264fed5-3e67-465e-b844-bae10e9ba860 None admin] PATH_INFO: `/v3/users/53e38c33537540a5a269f742bc1af0e2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:31.884667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264fed5-3e67-465e-b844-bae10e9ba860 None admin] RBAC: Authorizing `identity:get_user(user_id=53e38c33537540a5a269f742bc1af0e2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:31.885174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be44ef5-d07a-45d4-aaab-9318499924bb None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:31.886188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264fed5-3e67-465e-b844-bae10e9ba860 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:31.888094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 194/373] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:11:31 2022] GET /identity/v3/users/53e38c33537540a5a269f742bc1af0e2 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:31.888767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264fed5-3e67-465e-b844-bae10e9ba860 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:31.920438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:31.929153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23edf0-83fa-4f15-9cb1-ad4e74a24b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:31.930029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23edf0-83fa-4f15-9cb1-ad4e74a24b9d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:31.930315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23edf0-83fa-4f15-9cb1-ad4e74a24b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:31.930601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23edf0-83fa-4f15-9cb1-ad4e74a24b9d None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:31.931850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23edf0-83fa-4f15-9cb1-ad4e74a24b9d None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:31.933568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23edf0-83fa-4f15-9cb1-ad4e74a24b9d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:31.935994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 180/374] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:31 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:31.941076 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23edf0-83fa-4f15-9cb1-ad4e74a24b9d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:32.064578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23edf0-83fa-4f15-9cb1-ad4e74a24b9d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:32.089595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264fed5-3e67-465e-b844-bae10e9ba860 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:32.104609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b43c1-c6be-4a5f-a50b-90a496552667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:32.105660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b43c1-c6be-4a5f-a50b-90a496552667 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:32.106159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b43c1-c6be-4a5f-a50b-90a496552667 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:32.106654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b43c1-c6be-4a5f-a50b-90a496552667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:32.107684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b43c1-c6be-4a5f-a50b-90a496552667 None admin] RBAC: Adding query filter params (role.id=725793cd452f4a0b9bcacc1754592b62, user.id=53e38c33537540a5a269f742bc1af0e2, scope.system=all) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:32.108256 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b43c1-c6be-4a5f-a50b-90a496552667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:32.109906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b43c1-c6be-4a5f-a50b-90a496552667 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:32.123756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 181/375] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jun 16 00:11:31 2022] GET /identity/v3/role_assignments?user.id=53e38c33537540a5a269f742bc1af0e2&scope.system=all&role.id=725793cd452f4a0b9bcacc1754592b62 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:32.125031 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b43c1-c6be-4a5f-a50b-90a496552667 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:32.133908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596acd1-0d78-4400-9f2f-3e277a98b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:32.134587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596acd1-0d78-4400-9f2f-3e277a98b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:32.134871 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596acd1-0d78-4400-9f2f-3e277a98b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:32.135146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596acd1-0d78-4400-9f2f-3e277a98b6a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:32.192589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:32.212194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:32.215568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596acd1-0d78-4400-9f2f-3e277a98b6a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:32.217537 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596acd1-0d78-4400-9f2f-3e277a98b6a6 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:32.245900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b43c1-c6be-4a5f-a50b-90a496552667 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:32.285187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb454a-8942-4f98-a76c-4451e09c52fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:32.286365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb454a-8942-4f98-a76c-4451e09c52fb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:32.287173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb454a-8942-4f98-a76c-4451e09c52fb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:32.287942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb454a-8942-4f98-a76c-4451e09c52fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:32.289254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb454a-8942-4f98-a76c-4451e09c52fb None admin] RBAC: Adding query filter params (group.id=53f493090c0c4a74b050811995b3a9de, role.id=bad10ed55f6140b882d1fdd6994f1fa8, scope.project.id=75585a6ed1724a4199c43e9f777fe503) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:32.290091 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb454a-8942-4f98-a76c-4451e09c52fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:32.292049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb454a-8942-4f98-a76c-4451e09c52fb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:32.300592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 182/376] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 16 00:11:32 2022] GET /identity/v3/role_assignments?group.id=53f493090c0c4a74b050811995b3a9de&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=bad10ed55f6140b882d1fdd6994f1fa8 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:32.303328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cff4-7aab-4c39-b945-c663d27cf50d None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:32.308885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cff4-7aab-4c39-b945-c663d27cf50d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:32.309631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cff4-7aab-4c39-b945-c663d27cf50d None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:32.311730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 183/377] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:32.318161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085a900-a355-483b-acdd-dff56800ae5a None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:32.318981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085a900-a355-483b-acdd-dff56800ae5a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:32.320031 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085a900-a355-483b-acdd-dff56800ae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:32.355998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 195/378] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:32.355998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596acd1-0d78-4400-9f2f-3e277a98b6a6 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:32.361912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b085a900-a355-483b-acdd-dff56800ae5a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:32.364285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b085a900-a355-483b-acdd-dff56800ae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:32.464070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:32.468011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596acd1-0d78-4400-9f2f-3e277a98b6a6 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:32.506873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b57d2-de06-4ae9-aec8-994a037c2240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:32.507740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b57d2-de06-4ae9-aec8-994a037c2240 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:32.508062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b57d2-de06-4ae9-aec8-994a037c2240 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:32.508346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b57d2-de06-4ae9-aec8-994a037c2240 None admin] PATH_INFO: `/v3/projects/9f6ff6bbe76344e7a7f939e30a88483a` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:32.512903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b57d2-de06-4ae9-aec8-994a037c2240 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6ff6bbe76344e7a7f939e30a88483a)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:32.513796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 184/379] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:32.514575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b57d2-de06-4ae9-aec8-994a037c2240 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:32.520120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 196/380] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:32 2022] GET /identity/v3/projects/9f6ff6bbe76344e7a7f939e30a88483a => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:32.522581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085a900-a355-483b-acdd-dff56800ae5a None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:32.558277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b57d2-de06-4ae9-aec8-994a037c2240 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:32.604458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:32.690236 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085a900-a355-483b-acdd-dff56800ae5a None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:32.734533 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d682355-ccd0-443c-ae45-f0335b29bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:32.736307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d682355-ccd0-443c-ae45-f0335b29bd00 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:32.737104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d682355-ccd0-443c-ae45-f0335b29bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:32.737562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d682355-ccd0-443c-ae45-f0335b29bd00 None admin] PATH_INFO: `/v3/groups/c280db2914324552abb4de71f8fbf89c` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:32.745570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d682355-ccd0-443c-ae45-f0335b29bd00 None admin] RBAC: Authorizing `identity:get_group(group_id=c280db2914324552abb4de71f8fbf89c)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:32.747413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d682355-ccd0-443c-ae45-f0335b29bd00 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:32.753098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 185/381] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:32 2022] GET /identity/v3/groups/c280db2914324552abb4de71f8fbf89c => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:32.756688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d682355-ccd0-443c-ae45-f0335b29bd00 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:32.759297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b57d2-de06-4ae9-aec8-994a037c2240 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:32.861521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee7d64-769e-4a87-b915-304eba46e3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:32.862447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee7d64-769e-4a87-b915-304eba46e3ae None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:32.862827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee7d64-769e-4a87-b915-304eba46e3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:32.863183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee7d64-769e-4a87-b915-304eba46e3ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:32.868418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d682355-ccd0-443c-ae45-f0335b29bd00 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:32.880429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:32.883683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee7d64-769e-4a87-b915-304eba46e3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-b3ee7d64-769e-4a87-b915-304eba46e3ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:32.900856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:32.901795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:32.902599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 197/382] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:32.907884 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b92c1-b935-4008-ba14-5bd123eb4bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:32.908959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b92c1-b935-4008-ba14-5bd123eb4bce None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:32.909411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b92c1-b935-4008-ba14-5bd123eb4bce None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:32.909702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee7d64-769e-4a87-b915-304eba46e3ae None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:32.909985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b92c1-b935-4008-ba14-5bd123eb4bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:32.911525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b92c1-b935-4008-ba14-5bd123eb4bce None admin] RBAC: Adding query filter params (group.id=c280db2914324552abb4de71f8fbf89c, role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=9f6ff6bbe76344e7a7f939e30a88483a) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:32.912431 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b92c1-b935-4008-ba14-5bd123eb4bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:32.914468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b92c1-b935-4008-ba14-5bd123eb4bce None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:32.928140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 186/383] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 16 00:11:32 2022] GET /identity/v3/role_assignments?group.id=c280db2914324552abb4de71f8fbf89c&scope.project.id=9f6ff6bbe76344e7a7f939e30a88483a&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:32.960413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:33.076408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee7d64-769e-4a87-b915-304eba46e3ae None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:33.123061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f9e85-b3e3-49da-ac63-a86147e451de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:33.124125 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9e85-b3e3-49da-ac63-a86147e451de None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:33.124632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9e85-b3e3-49da-ac63-a86147e451de None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:33.125111 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f9e85-b3e3-49da-ac63-a86147e451de None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:33.126057 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f9e85-b3e3-49da-ac63-a86147e451de None admin] RBAC: Adding query filter params (name=member) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:33.126576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f9e85-b3e3-49da-ac63-a86147e451de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:33.128302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f9e85-b3e3-49da-ac63-a86147e451de None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:33.137827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 198/384] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:33.143610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b92c1-b935-4008-ba14-5bd123eb4bce None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:33.304778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b92c1-b935-4008-ba14-5bd123eb4bce None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:33.353782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e231aa9-c890-44ec-b633-ded6e47c89d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:33.354657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e231aa9-c890-44ec-b633-ded6e47c89d7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:33.354947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e231aa9-c890-44ec-b633-ded6e47c89d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:33.355233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e231aa9-c890-44ec-b633-ded6e47c89d7 None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:33.356701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e231aa9-c890-44ec-b633-ded6e47c89d7 None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:33.358162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e231aa9-c890-44ec-b633-ded6e47c89d7 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:33.360129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 187/385] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:33 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:33.366758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f9e85-b3e3-49da-ac63-a86147e451de None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:33.474604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:33.484758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f9e85-b3e3-49da-ac63-a86147e451de None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:33.524163 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd32088-6aba-4a2b-b574-e6cd4c2fcdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:33.525045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32088-6aba-4a2b-b574-e6cd4c2fcdff None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:33.525333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32088-6aba-4a2b-b574-e6cd4c2fcdff None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:33.525613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd32088-6aba-4a2b-b574-e6cd4c2fcdff None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:33.526832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd32088-6aba-4a2b-b574-e6cd4c2fcdff None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:33.528327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd32088-6aba-4a2b-b574-e6cd4c2fcdff None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:33.530351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 199/386] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:33 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:33.536290 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e231aa9-c890-44ec-b633-ded6e47c89d7 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:33.606014 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:33.681197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e231aa9-c890-44ec-b633-ded6e47c89d7 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:33.726627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a0430-b816-4c47-92da-c83abc5d548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:33.727928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a0430-b816-4c47-92da-c83abc5d548e None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:33.728450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a0430-b816-4c47-92da-c83abc5d548e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:33.728931 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a0430-b816-4c47-92da-c83abc5d548e None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/groups/53f493090c0c4a74b050811995b3a9de/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:33.731143 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a0430-b816-4c47-92da-c83abc5d548e None admin] RBAC: Authorizing `identity:create_grant(project_id=32f7396beaa9432bb7fd8ab77c3dfd90, group_id=53f493090c0c4a74b050811995b3a9de, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:33.732854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a0430-b816-4c47-92da-c83abc5d548e None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:33.759435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 188/387] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jun 16 00:11:33 2022] PUT /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/groups/53f493090c0c4a74b050811995b3a9de/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:34.312259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b758061-90b6-4ae9-a15d-58acf91405a6 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:34.312737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b758061-90b6-4ae9-a15d-58acf91405a6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:34.312737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b758061-90b6-4ae9-a15d-58acf91405a6 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:34.314267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 200/388] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:34.319828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f567b4-2191-468d-bec6-d64ddb898ebf None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:34.320170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f567b4-2191-468d-bec6-d64ddb898ebf None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:34.320455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f567b4-2191-468d-bec6-d64ddb898ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:34.345189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-38f567b4-2191-468d-bec6-d64ddb898ebf None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:34.346459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-38f567b4-2191-468d-bec6-d64ddb898ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:34.409073 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673759aa-dd99-4e39-a4b0-b9291b498a72 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:34.409691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673759aa-dd99-4e39-a4b0-b9291b498a72 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:34.410186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673759aa-dd99-4e39-a4b0-b9291b498a72 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:34.412071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 201/389] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:34.416751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cf052-52a6-421a-9d7f-b307732d792a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:34.417283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cf052-52a6-421a-9d7f-b307732d792a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:34.417773 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cf052-52a6-421a-9d7f-b307732d792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:34.432755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 189/390] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:34.452953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-fc5cf052-52a6-421a-9d7f-b307732d792a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:34.454559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-fc5cf052-52a6-421a-9d7f-b307732d792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:34.455171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f567b4-2191-468d-bec6-d64ddb898ebf None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:34.524404 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 202/391] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:34.524714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:34.550084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cf052-52a6-421a-9d7f-b307732d792a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:34.657362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cf052-52a6-421a-9d7f-b307732d792a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:34.668345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:34.702665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f567b4-2191-468d-bec6-d64ddb898ebf None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:34.729283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729f00-baa4-46b6-9eb2-4d09bccc1791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:34.730108 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729f00-baa4-46b6-9eb2-4d09bccc1791 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:34.730397 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729f00-baa4-46b6-9eb2-4d09bccc1791 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:34.730681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729f00-baa4-46b6-9eb2-4d09bccc1791 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:34.741930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ab4f3-ad4d-49d8-bb7e-fa9435ba3746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:34.743033 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab4f3-ad4d-49d8-bb7e-fa9435ba3746 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:34.743689 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab4f3-ad4d-49d8-bb7e-fa9435ba3746 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:34.744302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ab4f3-ad4d-49d8-bb7e-fa9435ba3746 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:34.755802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ab4f3-ad4d-49d8-bb7e-fa9435ba3746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:34.758870 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc729f00-baa4-46b6-9eb2-4d09bccc1791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-e88ab4f3-ad4d-49d8-bb7e-fa9435ba3746 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:34.764864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:34.766084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:34.766871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-dc729f00-baa4-46b6-9eb2-4d09bccc1791 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:34.767504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:34.768357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:34.769157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:34.772971 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 190/392] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:11:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:34.776565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 203/393] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:34.782565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ab4f3-ad4d-49d8-bb7e-fa9435ba3746 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:34.783624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729f00-baa4-46b6-9eb2-4d09bccc1791 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:34.896550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729f00-baa4-46b6-9eb2-4d09bccc1791 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:34.951244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:34.964863 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ab4f3-ad4d-49d8-bb7e-fa9435ba3746 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:34.968647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2347b0d-f7ca-4afc-a3e6-9398dcc7dcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:34.969383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347b0d-f7ca-4afc-a3e6-9398dcc7dcce None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:34.969675 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347b0d-f7ca-4afc-a3e6-9398dcc7dcce None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:34.969962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2347b0d-f7ca-4afc-a3e6-9398dcc7dcce None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:34.970729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2347b0d-f7ca-4afc-a3e6-9398dcc7dcce None admin] RBAC: Adding query filter params (name=member) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:34.971044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2347b0d-f7ca-4afc-a3e6-9398dcc7dcce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:34.972469 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2347b0d-f7ca-4afc-a3e6-9398dcc7dcce None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:34.983230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 204/394] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:34.988630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2347b0d-f7ca-4afc-a3e6-9398dcc7dcce None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:35.013114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:35.039429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0f28f-dedf-4ce9-9959-3a9da0132011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:35.040190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f28f-dedf-4ce9-9959-3a9da0132011 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.040482 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f28f-dedf-4ce9-9959-3a9da0132011 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.040767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0f28f-dedf-4ce9-9959-3a9da0132011 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.042213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0f28f-dedf-4ce9-9959-3a9da0132011 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:35.042790 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0f28f-dedf-4ce9-9959-3a9da0132011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:35.045411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0f28f-dedf-4ce9-9959-3a9da0132011 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:35.055399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 191/395] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:35.060544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0f28f-dedf-4ce9-9959-3a9da0132011 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:35.169845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0f28f-dedf-4ce9-9959-3a9da0132011 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:35.175130 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2347b0d-f7ca-4afc-a3e6-9398dcc7dcce None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:35.206955 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ee43-571f-4fea-8d9b-3e9085351a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:35.208409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ee43-571f-4fea-8d9b-3e9085351a33 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.208771 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ee43-571f-4fea-8d9b-3e9085351a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.209126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ee43-571f-4fea-8d9b-3e9085351a33 None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.210491 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93ee43-571f-4fea-8d9b-3e9085351a33 None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:35.212097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93ee43-571f-4fea-8d9b-3e9085351a33 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:35.214282 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 192/396] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:35 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:35.219498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ee43-571f-4fea-8d9b-3e9085351a33 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:35.243328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:35.247515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fb68c-3575-4d02-ac1a-316f44673a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:35.248453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb68c-3575-4d02-ac1a-316f44673a3f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.248736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb68c-3575-4d02-ac1a-316f44673a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.249013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fb68c-3575-4d02-ac1a-316f44673a3f None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.250349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fb68c-3575-4d02-ac1a-316f44673a3f None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:35.255487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fb68c-3575-4d02-ac1a-316f44673a3f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:35.258855 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 205/397] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:34 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:35.262712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fb68c-3575-4d02-ac1a-316f44673a3f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:35.387256 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ee43-571f-4fea-8d9b-3e9085351a33 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:35.410332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:35.438421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fb68c-3575-4d02-ac1a-316f44673a3f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:35.438896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4111556-cd08-4c78-85ad-d678a3e084fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:35.440260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4111556-cd08-4c78-85ad-d678a3e084fc None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.440762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4111556-cd08-4c78-85ad-d678a3e084fc None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.442787 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4111556-cd08-4c78-85ad-d678a3e084fc None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.444395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4111556-cd08-4c78-85ad-d678a3e084fc None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:35.446097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4111556-cd08-4c78-85ad-d678a3e084fc None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:35.449308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 193/398] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:35 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:35.451031 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7736ef8-9326-45ab-a7e8-9e90be0c1c72 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.451506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7736ef8-9326-45ab-a7e8-9e90be0c1c72 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.451954 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7736ef8-9326-45ab-a7e8-9e90be0c1c72 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.453893 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 194/399] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:35.457734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7736ef8-9326-45ab-a7e8-9e90be0c1c72 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:35.493267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73941d1-862b-4a05-9cfc-ab267d46f78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:35.494721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73941d1-862b-4a05-9cfc-ab267d46f78a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.495548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73941d1-862b-4a05-9cfc-ab267d46f78a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.496275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73941d1-862b-4a05-9cfc-ab267d46f78a None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.497692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73941d1-862b-4a05-9cfc-ab267d46f78a None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:35.499603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73941d1-862b-4a05-9cfc-ab267d46f78a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:35.502790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 206/400] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:35 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:35.504752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac668468-3f1d-4935-ba3b-1155331cfbe3 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.505239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac668468-3f1d-4935-ba3b-1155331cfbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.505701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac668468-3f1d-4935-ba3b-1155331cfbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.527277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ac668468-3f1d-4935-ba3b-1155331cfbe3 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:35.528783 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ac668468-3f1d-4935-ba3b-1155331cfbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:35.562371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:35.579098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7736ef8-9326-45ab-a7e8-9e90be0c1c72 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:35.599424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 207/401] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:35.600665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac668468-3f1d-4935-ba3b-1155331cfbe3 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:35.621296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e6c1d-5180-4610-b2ae-8ad0759968d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:35.622339 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e6c1d-5180-4610-b2ae-8ad0759968d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.622901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e6c1d-5180-4610-b2ae-8ad0759968d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.623198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e6c1d-5180-4610-b2ae-8ad0759968d2 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/groups/53f493090c0c4a74b050811995b3a9de/roles/bad10ed55f6140b882d1fdd6994f1fa8` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.625878 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e6c1d-5180-4610-b2ae-8ad0759968d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=32f7396beaa9432bb7fd8ab77c3dfd90, group_id=53f493090c0c4a74b050811995b3a9de, role_id=bad10ed55f6140b882d1fdd6994f1fa8)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:35.627606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e6c1d-5180-4610-b2ae-8ad0759968d2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:35.642755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 195/402] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jun 16 00:11:35 2022] PUT /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90/groups/53f493090c0c4a74b050811995b3a9de/roles/bad10ed55f6140b882d1fdd6994f1fa8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:35.652208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c780ec-5eeb-45d3-9c54-9cd79d286849 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.652208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c780ec-5eeb-45d3-9c54-9cd79d286849 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.652208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c780ec-5eeb-45d3-9c54-9cd79d286849 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.652208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 196/403] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:35.652208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c780ec-5eeb-45d3-9c54-9cd79d286849 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:35.701032 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:35.728244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac668468-3f1d-4935-ba3b-1155331cfbe3 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:35.766951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1925ac-ef40-4d17-a948-df122fb50726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:35.768191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1925ac-ef40-4d17-a948-df122fb50726 None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.768676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1925ac-ef40-4d17-a948-df122fb50726 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.769174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1925ac-ef40-4d17-a948-df122fb50726 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503/groups/53f493090c0c4a74b050811995b3a9de/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.771607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1925ac-ef40-4d17-a948-df122fb50726 None admin] RBAC: Authorizing `identity:create_grant(project_id=75585a6ed1724a4199c43e9f777fe503, group_id=53f493090c0c4a74b050811995b3a9de, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:35.773634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1925ac-ef40-4d17-a948-df122fb50726 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:35.792734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 208/404] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jun 16 00:11:35 2022] PUT /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503/groups/53f493090c0c4a74b050811995b3a9de/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:35.794504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798493ad-73c2-436d-a419-528d49fe08cb None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.795027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798493ad-73c2-436d-a419-528d49fe08cb None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.795510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798493ad-73c2-436d-a419-528d49fe08cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.815393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-798493ad-73c2-436d-a419-528d49fe08cb None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:35.817044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-798493ad-73c2-436d-a419-528d49fe08cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:35.825539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c780ec-5eeb-45d3-9c54-9cd79d286849 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:35.883010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c708ecd-94dc-4275-9788-7bc2ec9b71f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:35.884348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708ecd-94dc-4275-9788-7bc2ec9b71f1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:35.884885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708ecd-94dc-4275-9788-7bc2ec9b71f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:35.885366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708ecd-94dc-4275-9788-7bc2ec9b71f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:35.899609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c708ecd-94dc-4275-9788-7bc2ec9b71f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-3c708ecd-94dc-4275-9788-7bc2ec9b71f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:35.910060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:35.911164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:35.912005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:35.915161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 197/405] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:11:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:35.921487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c708ecd-94dc-4275-9788-7bc2ec9b71f1 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:35.933349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:35.981914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 209/406] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:36.024343 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798493ad-73c2-436d-a419-528d49fe08cb None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:36.036935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c708ecd-94dc-4275-9788-7bc2ec9b71f1 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:36.077700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da49cd-9c3c-46c0-9247-4962dfd19c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:36.078392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da49cd-9c3c-46c0-9247-4962dfd19c41 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:36.078677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da49cd-9c3c-46c0-9247-4962dfd19c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:36.078967 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da49cd-9c3c-46c0-9247-4962dfd19c41 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:36.079725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da49cd-9c3c-46c0-9247-4962dfd19c41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:36.080789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da49cd-9c3c-46c0-9247-4962dfd19c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:36.082712 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da49cd-9c3c-46c0-9247-4962dfd19c41 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:36.092468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 198/407] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:36.098556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da49cd-9c3c-46c0-9247-4962dfd19c41 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:36.131637 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:36.173311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:36.205892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da49cd-9c3c-46c0-9247-4962dfd19c41 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:36.222209 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798493ad-73c2-436d-a419-528d49fe08cb None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:36.242307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad424f54-5549-439e-956a-04d825bec713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:36.243147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad424f54-5549-439e-956a-04d825bec713 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:36.243442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad424f54-5549-439e-956a-04d825bec713 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:36.243728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad424f54-5549-439e-956a-04d825bec713 None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:36.245115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad424f54-5549-439e-956a-04d825bec713 None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:36.252118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad424f54-5549-439e-956a-04d825bec713 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:36.252118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 199/408] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:36 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:36.253926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad424f54-5549-439e-956a-04d825bec713 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:36.306492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef61d-a686-46a9-8723-37d58929dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:36.307305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef61d-a686-46a9-8723-37d58929dc99 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:36.307589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef61d-a686-46a9-8723-37d58929dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:36.307862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef61d-a686-46a9-8723-37d58929dc99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:36.335264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ef61d-a686-46a9-8723-37d58929dc99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-7a3ef61d-a686-46a9-8723-37d58929dc99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:36.353060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:36.353956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:36.354746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 210/409] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:11:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:11:36.358598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad424f54-5549-439e-956a-04d825bec713 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:36.365014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef61d-a686-46a9-8723-37d58929dc99 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:36.393680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b29a5-f7d0-4400-82bb-65b0c02fb981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:36.394602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b29a5-f7d0-4400-82bb-65b0c02fb981 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:36.395484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b29a5-f7d0-4400-82bb-65b0c02fb981 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:36.395774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b29a5-f7d0-4400-82bb-65b0c02fb981 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:36.399703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b29a5-f7d0-4400-82bb-65b0c02fb981 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:36.399703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b29a5-f7d0-4400-82bb-65b0c02fb981 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:36.400656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 200/410] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:36 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:36.406223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b29a5-f7d0-4400-82bb-65b0c02fb981 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:36.419988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:36.549822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b29a5-f7d0-4400-82bb-65b0c02fb981 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:36.595347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef61d-a686-46a9-8723-37d58929dc99 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:36.612158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4d850-6ea7-43bd-9f2e-bb47108740c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:36.613144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d850-6ea7-43bd-9f2e-bb47108740c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:36.614027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d850-6ea7-43bd-9f2e-bb47108740c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:36.614410 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4d850-6ea7-43bd-9f2e-bb47108740c3 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503/groups/53f493090c0c4a74b050811995b3a9de/roles/bad10ed55f6140b882d1fdd6994f1fa8` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:36.616712 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4d850-6ea7-43bd-9f2e-bb47108740c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=75585a6ed1724a4199c43e9f777fe503, group_id=53f493090c0c4a74b050811995b3a9de, role_id=bad10ed55f6140b882d1fdd6994f1fa8)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:36.618294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4d850-6ea7-43bd-9f2e-bb47108740c3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:36.623376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:36.633987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 201/411] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jun 16 00:11:36 2022] PUT /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503/groups/53f493090c0c4a74b050811995b3a9de/roles/bad10ed55f6140b882d1fdd6994f1fa8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:11:36.634178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95575c7-f0bc-4c8a-85e4-074a749c30de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:36.635729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38515e53-c0ac-45fa-bcb3-03b9f4d67891 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:36.636186 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38515e53-c0ac-45fa-bcb3-03b9f4d67891 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:36.636604 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38515e53-c0ac-45fa-bcb3-03b9f4d67891 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:36.642036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 202/412] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:36.642227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95575c7-f0bc-4c8a-85e4-074a749c30de None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:36.642227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95575c7-f0bc-4c8a-85e4-074a749c30de None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:36.642227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95575c7-f0bc-4c8a-85e4-074a749c30de None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:36.642586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95575c7-f0bc-4c8a-85e4-074a749c30de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:36.642960 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95575c7-f0bc-4c8a-85e4-074a749c30de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:36.644603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95575c7-f0bc-4c8a-85e4-074a749c30de None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:36.645677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741045d9-5eeb-44e3-b051-6e5855139e8d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:36.646273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741045d9-5eeb-44e3-b051-6e5855139e8d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:36.646744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741045d9-5eeb-44e3-b051-6e5855139e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:36.666481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 211/413] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:36.670883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-741045d9-5eeb-44e3-b051-6e5855139e8d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:36.671036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95575c7-f0bc-4c8a-85e4-074a749c30de None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:36.672506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-741045d9-5eeb-44e3-b051-6e5855139e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:36.777965 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:36.790951 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 203/414] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:36.818247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741045d9-5eeb-44e3-b051-6e5855139e8d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:36.884602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95575c7-f0bc-4c8a-85e4-074a749c30de None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:36.923929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4203250-b388-4e54-9c93-e14995bd8fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:36.924834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4203250-b388-4e54-9c93-e14995bd8fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:36.925147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4203250-b388-4e54-9c93-e14995bd8fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:36.925394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4203250-b388-4e54-9c93-e14995bd8fa0 None admin] PATH_INFO: `/v3/groups/c280db2914324552abb4de71f8fbf89c` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:36.926646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4203250-b388-4e54-9c93-e14995bd8fa0 None admin] RBAC: Authorizing `identity:get_group(group_id=c280db2914324552abb4de71f8fbf89c)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:36.928126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4203250-b388-4e54-9c93-e14995bd8fa0 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:36.930054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 212/415] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:36 2022] GET /identity/v3/groups/c280db2914324552abb4de71f8fbf89c => generated 229 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:36.934770 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741045d9-5eeb-44e3-b051-6e5855139e8d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:36.935297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4203250-b388-4e54-9c93-e14995bd8fa0 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:36.977299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d8a96-6861-4688-a4dd-070cb1fe681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:36.978192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d8a96-6861-4688-a4dd-070cb1fe681b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:36.978480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d8a96-6861-4688-a4dd-070cb1fe681b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:36.978810 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d8a96-6861-4688-a4dd-070cb1fe681b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:37.006723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:37.008794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d8a96-6861-4688-a4dd-070cb1fe681b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-a41d8a96-6861-4688-a4dd-070cb1fe681b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:37.017468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:37.018414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:37.020412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 204/416] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:37.037207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d8a96-6861-4688-a4dd-070cb1fe681b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:37.058913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4203250-b388-4e54-9c93-e14995bd8fa0 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:37.097569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329497f-ca92-4da1-b9fd-96a0c4c2d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:37.099274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329497f-ca92-4da1-b9fd-96a0c4c2d771 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:37.099564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329497f-ca92-4da1-b9fd-96a0c4c2d771 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:37.099845 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329497f-ca92-4da1-b9fd-96a0c4c2d771 None admin] PATH_INFO: `/v3/projects/9f6ff6bbe76344e7a7f939e30a88483a` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:37.101135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329497f-ca92-4da1-b9fd-96a0c4c2d771 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6ff6bbe76344e7a7f939e30a88483a)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:37.102624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329497f-ca92-4da1-b9fd-96a0c4c2d771 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:37.104616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 213/417] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:36 2022] GET /identity/v3/projects/9f6ff6bbe76344e7a7f939e30a88483a => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:37.110170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329497f-ca92-4da1-b9fd-96a0c4c2d771 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:37.177361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:37.219566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329497f-ca92-4da1-b9fd-96a0c4c2d771 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:37.244011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:37.256004 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88e43d-2906-4205-9f73-50ba0b9e42f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:37.256908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e43d-2906-4205-9f73-50ba0b9e42f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:37.257196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e43d-2906-4205-9f73-50ba0b9e42f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:37.257476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e43d-2906-4205-9f73-50ba0b9e42f6 None admin] PATH_INFO: `/v3/projects/9f6ff6bbe76344e7a7f939e30a88483a/groups/c280db2914324552abb4de71f8fbf89c/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:37.259479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88e43d-2906-4205-9f73-50ba0b9e42f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f6ff6bbe76344e7a7f939e30a88483a, group_id=c280db2914324552abb4de71f8fbf89c, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:37.260975 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88e43d-2906-4205-9f73-50ba0b9e42f6 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:37.272362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d8a96-6861-4688-a4dd-070cb1fe681b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:37.286566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 214/418] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jun 16 00:11:37 2022] PUT /identity/v3/projects/9f6ff6bbe76344e7a7f939e30a88483a/groups/c280db2914324552abb4de71f8fbf89c/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:37.314962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344642c-54b1-4186-b178-8e3dffa2ef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:37.315649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344642c-54b1-4186-b178-8e3dffa2ef73 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:37.315940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344642c-54b1-4186-b178-8e3dffa2ef73 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:37.316250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344642c-54b1-4186-b178-8e3dffa2ef73 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:37.317552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344642c-54b1-4186-b178-8e3dffa2ef73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:37.317869 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344642c-54b1-4186-b178-8e3dffa2ef73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:37.319338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344642c-54b1-4186-b178-8e3dffa2ef73 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:37.328676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 205/419] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:37.337331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88e43d-2906-4205-9f73-50ba0b9e42f6 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:37.473994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88e43d-2906-4205-9f73-50ba0b9e42f6 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:37.508305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb4f05-4508-4cb4-81fe-b66c7a83baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:37.508968 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb4f05-4508-4cb4-81fe-b66c7a83baa3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:37.509259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb4f05-4508-4cb4-81fe-b66c7a83baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:37.509543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb4f05-4508-4cb4-81fe-b66c7a83baa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:37.562322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:37.582849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb4f05-4508-4cb4-81fe-b66c7a83baa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:37.584594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb4f05-4508-4cb4-81fe-b66c7a83baa3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:37.725145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 215/420] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:37.730456 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344642c-54b1-4186-b178-8e3dffa2ef73 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:37.884659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344642c-54b1-4186-b178-8e3dffa2ef73 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:37.912634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:37.940860 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51672bbf-59e9-4022-abb8-1ee6cb664882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:37.941760 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51672bbf-59e9-4022-abb8-1ee6cb664882 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:37.942050 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51672bbf-59e9-4022-abb8-1ee6cb664882 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:37.942329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51672bbf-59e9-4022-abb8-1ee6cb664882 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:37.943546 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51672bbf-59e9-4022-abb8-1ee6cb664882 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:37.945014 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51672bbf-59e9-4022-abb8-1ee6cb664882 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:37.947084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 206/421] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:37 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:37.952603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb4f05-4508-4cb4-81fe-b66c7a83baa3 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:38.112793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:38.131219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb4f05-4508-4cb4-81fe-b66c7a83baa3 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:38.183467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9709d9-bcb3-4f2e-9524-9e868691fce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:38.184371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9709d9-bcb3-4f2e-9524-9e868691fce9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:38.184656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9709d9-bcb3-4f2e-9524-9e868691fce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:38.184936 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9709d9-bcb3-4f2e-9524-9e868691fce9 None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:38.188674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9709d9-bcb3-4f2e-9524-9e868691fce9 None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:38.190133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9709d9-bcb3-4f2e-9524-9e868691fce9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:38.192655 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 216/422] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:37 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:38.198624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51672bbf-59e9-4022-abb8-1ee6cb664882 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:38.338876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51672bbf-59e9-4022-abb8-1ee6cb664882 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:38.376047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0340a28-f349-4968-a277-7fb25c3cff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:38.376729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340a28-f349-4968-a277-7fb25c3cff8c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:38.377018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340a28-f349-4968-a277-7fb25c3cff8c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:38.377301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0340a28-f349-4968-a277-7fb25c3cff8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:38.378146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340a28-f349-4968-a277-7fb25c3cff8c None admin] RBAC: Adding query filter params (group.id=53f493090c0c4a74b050811995b3a9de, role.id=531d1ead7d164c708ad131b14d2f9301, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:38.378467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340a28-f349-4968-a277-7fb25c3cff8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:38.380060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0340a28-f349-4968-a277-7fb25c3cff8c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:38.387002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 207/423] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 16 00:11:38 2022] GET /identity/v3/role_assignments?group.id=53f493090c0c4a74b050811995b3a9de&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:38.397751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322f011-eba5-4474-be3d-0d09f60facf2 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:38.398384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322f011-eba5-4474-be3d-0d09f60facf2 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:38.398868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322f011-eba5-4474-be3d-0d09f60facf2 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:38.401471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 217/424] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:38.406009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f54f1-3650-43c7-97b5-5a0c9f4fcad9 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:38.406294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f54f1-3650-43c7-97b5-5a0c9f4fcad9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:38.406581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f54f1-3650-43c7-97b5-5a0c9f4fcad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:38.421324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ac30-2834-47dc-b537-5e17f3f64f50 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:38.421630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ac30-2834-47dc-b537-5e17f3f64f50 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:38.421891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ac30-2834-47dc-b537-5e17f3f64f50 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:38.423473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 218/425] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:38.428946 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e970e97-849e-489b-a354-7e50f48d23ef None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:38.429302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e970e97-849e-489b-a354-7e50f48d23ef None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:38.429589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e970e97-849e-489b-a354-7e50f48d23ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:38.437690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6d2f54f1-3650-43c7-97b5-5a0c9f4fcad9 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:38.438910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6d2f54f1-3650-43c7-97b5-5a0c9f4fcad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:38.466717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2e970e97-849e-489b-a354-7e50f48d23ef None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:38.468054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2e970e97-849e-489b-a354-7e50f48d23ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:38.548471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:38.590226 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 208/426] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:38.602313 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 219/427] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:38.620175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f54f1-3650-43c7-97b5-5a0c9f4fcad9 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:38.625014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e970e97-849e-489b-a354-7e50f48d23ef None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:38.729642 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:38.743530 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f54f1-3650-43c7-97b5-5a0c9f4fcad9 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:38.753404 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e970e97-849e-489b-a354-7e50f48d23ef None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:38.792106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939d27c-368f-43e7-b6f2-e22b950ffb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:38.792935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d27c-368f-43e7-b6f2-e22b950ffb47 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:38.793185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d27c-368f-43e7-b6f2-e22b950ffb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:38.793455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d27c-368f-43e7-b6f2-e22b950ffb47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:38.805534 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055ba10-d472-4043-a821-c8421b1277da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:38.806352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ba10-d472-4043-a821-c8421b1277da None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:38.806640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ba10-d472-4043-a821-c8421b1277da None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:38.806916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ba10-d472-4043-a821-c8421b1277da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:38.809585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939d27c-368f-43e7-b6f2-e22b950ffb47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:38.818852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5055ba10-d472-4043-a821-c8421b1277da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-7939d27c-368f-43e7-b6f2-e22b950ffb47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:38.819648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:38.820567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:38.821350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:38.822490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 209/428] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:11:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-5055ba10-d472-4043-a821-c8421b1277da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:38.827213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:38.829184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:11:38.830939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:38.833921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939d27c-368f-43e7-b6f2-e22b950ffb47 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:38.834016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 220/429] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:38.839664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055ba10-d472-4043-a821-c8421b1277da None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:38.885769 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:38.952752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939d27c-368f-43e7-b6f2-e22b950ffb47 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:38.975325 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055ba10-d472-4043-a821-c8421b1277da None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:38.995539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0448f-f65a-4ceb-b40e-d487f4b4261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:38.996277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0448f-f65a-4ceb-b40e-d487f4b4261d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:38.996564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0448f-f65a-4ceb-b40e-d487f4b4261d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:38.996844 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0448f-f65a-4ceb-b40e-d487f4b4261d None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:38.997599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0448f-f65a-4ceb-b40e-d487f4b4261d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:38.997913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0448f-f65a-4ceb-b40e-d487f4b4261d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:38.999415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0448f-f65a-4ceb-b40e-d487f4b4261d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:39.009767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 210/430] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:39.015294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0448f-f65a-4ceb-b40e-d487f4b4261d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:39.016613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276e9da-0dc7-40fe-8f0e-aa7e56b79267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:39.017771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276e9da-0dc7-40fe-8f0e-aa7e56b79267 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.018054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276e9da-0dc7-40fe-8f0e-aa7e56b79267 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.018334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276e9da-0dc7-40fe-8f0e-aa7e56b79267 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.019103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276e9da-0dc7-40fe-8f0e-aa7e56b79267 None admin] RBAC: Adding query filter params (name=member) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:39.019417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276e9da-0dc7-40fe-8f0e-aa7e56b79267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:39.025022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276e9da-0dc7-40fe-8f0e-aa7e56b79267 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:39.035007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 221/431] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:11:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:39.040838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276e9da-0dc7-40fe-8f0e-aa7e56b79267 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:39.044833 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:39.132840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0448f-f65a-4ceb-b40e-d487f4b4261d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:39.134547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:39.172245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276e9da-0dc7-40fe-8f0e-aa7e56b79267 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:39.173690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554306c6-19fb-4df9-af41-128fdab56413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:39.174542 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554306c6-19fb-4df9-af41-128fdab56413 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.174948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554306c6-19fb-4df9-af41-128fdab56413 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.176702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554306c6-19fb-4df9-af41-128fdab56413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.217906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28506a41-edaf-44d6-aeb0-522f22258972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:39.218804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28506a41-edaf-44d6-aeb0-522f22258972 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.219255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28506a41-edaf-44d6-aeb0-522f22258972 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.219670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28506a41-edaf-44d6-aeb0-522f22258972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.256172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554306c6-19fb-4df9-af41-128fdab56413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:39.257989 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554306c6-19fb-4df9-af41-128fdab56413 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:39.309842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28506a41-edaf-44d6-aeb0-522f22258972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:39.311519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28506a41-edaf-44d6-aeb0-522f22258972 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:39.314785 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:39.391208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 211/432] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:11:39.396987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554306c6-19fb-4df9-af41-128fdab56413 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:39.399481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:39.446982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 222/433] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:11:39.448365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2152b7-d8f3-4f70-9a5d-452f85ee8038 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.448662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2152b7-d8f3-4f70-9a5d-452f85ee8038 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.449177 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2152b7-d8f3-4f70-9a5d-452f85ee8038 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.450196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 223/434] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:39.454823 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2152b7-d8f3-4f70-9a5d-452f85ee8038 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:39.514675 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554306c6-19fb-4df9-af41-128fdab56413 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:39.554070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2b18a-c756-4d1f-b874-748c44953a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:39.554928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b18a-c756-4d1f-b874-748c44953a36 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.555421 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b18a-c756-4d1f-b874-748c44953a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.555528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b18a-c756-4d1f-b874-748c44953a36 None admin] PATH_INFO: `/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.556707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b18a-c756-4d1f-b874-748c44953a36 None admin] RBAC: Authorizing `identity:get_project(project_id=32f7396beaa9432bb7fd8ab77c3dfd90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:39.558086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b18a-c756-4d1f-b874-748c44953a36 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:39.559924 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 212/435] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:39 2022] GET /identity/v3/projects/32f7396beaa9432bb7fd8ab77c3dfd90 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:39.560977 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd24d4-a57b-4016-ae06-59eaf6bc399a None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.561275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd24d4-a57b-4016-ae06-59eaf6bc399a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.561546 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd24d4-a57b-4016-ae06-59eaf6bc399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.566850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2152b7-d8f3-4f70-9a5d-452f85ee8038 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:39.570055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:39.578195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-03fd24d4-a57b-4016-ae06-59eaf6bc399a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:39.579179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-03fd24d4-a57b-4016-ae06-59eaf6bc399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:39.604779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349f20d-79c3-42b2-aed4-cc437bb19a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:39.605794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349f20d-79c3-42b2-aed4-cc437bb19a6f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.606079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349f20d-79c3-42b2-aed4-cc437bb19a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.606347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349f20d-79c3-42b2-aed4-cc437bb19a6f None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.607534 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349f20d-79c3-42b2-aed4-cc437bb19a6f None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:39.608993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349f20d-79c3-42b2-aed4-cc437bb19a6f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:39.615488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 224/436] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:39 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:39.615488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349f20d-79c3-42b2-aed4-cc437bb19a6f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:39.649908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:39.655325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 213/437] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:39.656394 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd24d4-a57b-4016-ae06-59eaf6bc399a None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:39.725154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349f20d-79c3-42b2-aed4-cc437bb19a6f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:39.759725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f26cb8-5304-458c-88be-5b937986f603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:39.760612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f26cb8-5304-458c-88be-5b937986f603 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.760889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f26cb8-5304-458c-88be-5b937986f603 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.761160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f26cb8-5304-458c-88be-5b937986f603 None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.762334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f26cb8-5304-458c-88be-5b937986f603 None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:39.763782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f26cb8-5304-458c-88be-5b937986f603 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:39.764384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd24d4-a57b-4016-ae06-59eaf6bc399a None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:39.770973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 225/438] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:39 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:39.770973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f26cb8-5304-458c-88be-5b937986f603 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:39.810861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871f0d8-cd24-4dfa-9e98-d38a3952f5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:39.812611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871f0d8-cd24-4dfa-9e98-d38a3952f5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.813097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871f0d8-cd24-4dfa-9e98-d38a3952f5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.813571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871f0d8-cd24-4dfa-9e98-d38a3952f5b0 None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.814602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:39.816777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871f0d8-cd24-4dfa-9e98-d38a3952f5b0 None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:39.818889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871f0d8-cd24-4dfa-9e98-d38a3952f5b0 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:39.824203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 214/439] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:39 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:39.825134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871f0d8-cd24-4dfa-9e98-d38a3952f5b0 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:39.895095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f26cb8-5304-458c-88be-5b937986f603 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:39.900858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:39.928620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b802652-b0b9-46c5-b570-98490cbf5336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:39.929423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802652-b0b9-46c5-b570-98490cbf5336 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.929709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802652-b0b9-46c5-b570-98490cbf5336 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.929986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802652-b0b9-46c5-b570-98490cbf5336 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.934421 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871f0d8-cd24-4dfa-9e98-d38a3952f5b0 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:39.940000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b802652-b0b9-46c5-b570-98490cbf5336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-4b802652-b0b9-46c5-b570-98490cbf5336 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:39.948891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:39.949804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:39.950620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 226/440] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:11:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:39.951278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b802652-b0b9-46c5-b570-98490cbf5336 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:39.972265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb62e8-1025-4a40-a47b-9348038340d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:39.972912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb62e8-1025-4a40-a47b-9348038340d0 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.973194 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb62e8-1025-4a40-a47b-9348038340d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.973467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb62e8-1025-4a40-a47b-9348038340d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.974310 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb62e8-1025-4a40-a47b-9348038340d0 None admin] RBAC: Adding query filter params (group.id=53f493090c0c4a74b050811995b3a9de, role.id=bad10ed55f6140b882d1fdd6994f1fa8, scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:39.974622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb62e8-1025-4a40-a47b-9348038340d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:39.976126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb62e8-1025-4a40-a47b-9348038340d0 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:39.981812 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 215/441] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 16 00:11:39 2022] GET /identity/v3/role_assignments?group.id=53f493090c0c4a74b050811995b3a9de&scope.project.id=32f7396beaa9432bb7fd8ab77c3dfd90&role.id=bad10ed55f6140b882d1fdd6994f1fa8 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:39.983042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d95589-c429-4c66-94a8-6d0eb5777351 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:39.983332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d95589-c429-4c66-94a8-6d0eb5777351 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:39.983605 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d95589-c429-4c66-94a8-6d0eb5777351 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:39.985006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 216/442] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:39.985634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d95589-c429-4c66-94a8-6d0eb5777351 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:40.068674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:40.072696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b802652-b0b9-46c5-b570-98490cbf5336 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:40.109547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d95589-c429-4c66-94a8-6d0eb5777351 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:40.113795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040a3dc-9f54-4071-a537-a89400ce81f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:40.114476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a3dc-9f54-4071-a537-a89400ce81f2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:40.114761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a3dc-9f54-4071-a537-a89400ce81f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:40.115036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a3dc-9f54-4071-a537-a89400ce81f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:40.115876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040a3dc-9f54-4071-a537-a89400ce81f2 None admin] RBAC: Adding query filter params (group.id=53f493090c0c4a74b050811995b3a9de, role.id=531d1ead7d164c708ad131b14d2f9301, scope.project.id=75585a6ed1724a4199c43e9f777fe503) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:40.116220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040a3dc-9f54-4071-a537-a89400ce81f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:40.117683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040a3dc-9f54-4071-a537-a89400ce81f2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:40.124546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 227/443] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 16 00:11:39 2022] GET /identity/v3/role_assignments?group.id=53f493090c0c4a74b050811995b3a9de&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=531d1ead7d164c708ad131b14d2f9301 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:40.125672 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f123be-ac7e-419b-9651-368da366ac88 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:40.125965 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f123be-ac7e-419b-9651-368da366ac88 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:40.126241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f123be-ac7e-419b-9651-368da366ac88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:40.146755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-89f123be-ac7e-419b-9651-368da366ac88 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:40.148705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-89f123be-ac7e-419b-9651-368da366ac88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:40.160045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:40.167877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b3489-6422-4b88-bea4-5a89a5fbbe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:40.168688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3489-6422-4b88-bea4-5a89a5fbbe61 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:40.168980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3489-6422-4b88-bea4-5a89a5fbbe61 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:40.169262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3489-6422-4b88-bea4-5a89a5fbbe61 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:40.170034 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b3489-6422-4b88-bea4-5a89a5fbbe61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:40.170346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b3489-6422-4b88-bea4-5a89a5fbbe61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:40.171742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b3489-6422-4b88-bea4-5a89a5fbbe61 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:40.187363 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 217/444] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:40.191650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b3489-6422-4b88-bea4-5a89a5fbbe61 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:40.240297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 228/445] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:40.267716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f123be-ac7e-419b-9651-368da366ac88 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:40.322520 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b3489-6422-4b88-bea4-5a89a5fbbe61 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:40.370912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66a033-5661-4fce-896b-212938badb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:40.371571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66a033-5661-4fce-896b-212938badb51 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:40.371856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66a033-5661-4fce-896b-212938badb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:40.372169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66a033-5661-4fce-896b-212938badb51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:40.397598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:40.405397 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f123be-ac7e-419b-9651-368da366ac88 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:40.439953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:40.449205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66a033-5661-4fce-896b-212938badb51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:40.450889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66a033-5661-4fce-896b-212938badb51 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:40.451413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549315fa-1b55-4b48-9dfa-7647a2b49117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:40.452256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549315fa-1b55-4b48-9dfa-7647a2b49117 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:40.452531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549315fa-1b55-4b48-9dfa-7647a2b49117 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:40.452814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549315fa-1b55-4b48-9dfa-7647a2b49117 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:40.467911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549315fa-1b55-4b48-9dfa-7647a2b49117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-549315fa-1b55-4b48-9dfa-7647a2b49117 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:40.476348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:40.477407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:40.478366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 229/446] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:11:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:11:40.483489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549315fa-1b55-4b48-9dfa-7647a2b49117 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:40.568054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 218/447] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:11:40.573461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66a033-5661-4fce-896b-212938badb51 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:40.602539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549315fa-1b55-4b48-9dfa-7647a2b49117 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:40.635276 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e287fe4-ca6b-40c4-9e41-7dafa749f3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:40.635942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287fe4-ca6b-40c4-9e41-7dafa749f3ed None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:40.636268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287fe4-ca6b-40c4-9e41-7dafa749f3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:40.636547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e287fe4-ca6b-40c4-9e41-7dafa749f3ed None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:40.637295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e287fe4-ca6b-40c4-9e41-7dafa749f3ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:40.637605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e287fe4-ca6b-40c4-9e41-7dafa749f3ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:40.638973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e287fe4-ca6b-40c4-9e41-7dafa749f3ed None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:40.647269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 230/448] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:40.652700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e287fe4-ca6b-40c4-9e41-7dafa749f3ed None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:40.665892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:40.670570 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:40.672844 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66a033-5661-4fce-896b-212938badb51 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:40.706386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab11ff-f369-4b89-925c-f21337a1ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:40.707745 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab11ff-f369-4b89-925c-f21337a1ac79 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:40.708060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab11ff-f369-4b89-925c-f21337a1ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:40.708336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab11ff-f369-4b89-925c-f21337a1ac79 None admin] PATH_INFO: `/v3/projects/75585a6ed1724a4199c43e9f777fe503` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:40.709516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab11ff-f369-4b89-925c-f21337a1ac79 None admin] RBAC: Authorizing `identity:get_project(project_id=75585a6ed1724a4199c43e9f777fe503)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:40.710955 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab11ff-f369-4b89-925c-f21337a1ac79 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:40.712666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 219/449] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:40 2022] GET /identity/v3/projects/75585a6ed1724a4199c43e9f777fe503 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:40.718232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab11ff-f369-4b89-925c-f21337a1ac79 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:40.750899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e287fe4-ca6b-40c4-9e41-7dafa749f3ed None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:40.784609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348022d-6147-4f43-89bb-b746d2926d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:40.785842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348022d-6147-4f43-89bb-b746d2926d56 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:40.786130 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348022d-6147-4f43-89bb-b746d2926d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:40.786412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348022d-6147-4f43-89bb-b746d2926d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:40.815154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab11ff-f369-4b89-925c-f21337a1ac79 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:40.847578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443596e0-f4fd-4eed-9c78-38a150f4b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:40.848475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443596e0-f4fd-4eed-9c78-38a150f4b485 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:40.848758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443596e0-f4fd-4eed-9c78-38a150f4b485 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:40.849034 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443596e0-f4fd-4eed-9c78-38a150f4b485 None admin] PATH_INFO: `/v3/groups/53f493090c0c4a74b050811995b3a9de` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:40.850258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443596e0-f4fd-4eed-9c78-38a150f4b485 None admin] RBAC: Authorizing `identity:get_group(group_id=53f493090c0c4a74b050811995b3a9de)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:40.851684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443596e0-f4fd-4eed-9c78-38a150f4b485 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:40.853309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 220/450] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:40 2022] GET /identity/v3/groups/53f493090c0c4a74b050811995b3a9de => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:40.853900 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348022d-6147-4f43-89bb-b746d2926d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:40.855435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348022d-6147-4f43-89bb-b746d2926d56 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:40.859179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443596e0-f4fd-4eed-9c78-38a150f4b485 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:40.872587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:40.889690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:40.953860 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 231/451] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:11:40.957889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443596e0-f4fd-4eed-9c78-38a150f4b485 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:40.959304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348022d-6147-4f43-89bb-b746d2926d56 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:40.991425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d232d89-aa5e-4fbf-b596-466400ff8248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:40.992094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d232d89-aa5e-4fbf-b596-466400ff8248 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:40.992380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d232d89-aa5e-4fbf-b596-466400ff8248 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:40.992656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d232d89-aa5e-4fbf-b596-466400ff8248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:40.993471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d232d89-aa5e-4fbf-b596-466400ff8248 None admin] RBAC: Adding query filter params (group.id=53f493090c0c4a74b050811995b3a9de, role.id=bad10ed55f6140b882d1fdd6994f1fa8, scope.project.id=75585a6ed1724a4199c43e9f777fe503) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:40.993782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d232d89-aa5e-4fbf-b596-466400ff8248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:40.995194 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d232d89-aa5e-4fbf-b596-466400ff8248 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:41.001215 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 221/452] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 16 00:11:40 2022] GET /identity/v3/role_assignments?group.id=53f493090c0c4a74b050811995b3a9de&scope.project.id=75585a6ed1724a4199c43e9f777fe503&role.id=bad10ed55f6140b882d1fdd6994f1fa8 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:41.063679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348022d-6147-4f43-89bb-b746d2926d56 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:41.081401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:41.100525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca944a-11d3-4871-a174-e263442dbad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:41.101317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca944a-11d3-4871-a174-e263442dbad0 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:41.101601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca944a-11d3-4871-a174-e263442dbad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:41.101875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca944a-11d3-4871-a174-e263442dbad0 None admin] PATH_INFO: `/v3/projects/9f6ff6bbe76344e7a7f939e30a88483a` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:41.103115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca944a-11d3-4871-a174-e263442dbad0 None admin] RBAC: Authorizing `identity:get_project(project_id=9f6ff6bbe76344e7a7f939e30a88483a)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:41.104635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca944a-11d3-4871-a174-e263442dbad0 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:41.106360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 232/453] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:11:40 2022] GET /identity/v3/projects/9f6ff6bbe76344e7a7f939e30a88483a => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:41.112119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d232d89-aa5e-4fbf-b596-466400ff8248 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:41.206716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:41.214433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d232d89-aa5e-4fbf-b596-466400ff8248 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:41.249783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa62c0-6423-4f05-887c-f262268ebd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:41.250662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa62c0-6423-4f05-887c-f262268ebd3e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:41.250946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa62c0-6423-4f05-887c-f262268ebd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:41.251223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa62c0-6423-4f05-887c-f262268ebd3e None admin] PATH_INFO: `/v3/groups/c280db2914324552abb4de71f8fbf89c` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:41.252418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa62c0-6423-4f05-887c-f262268ebd3e None admin] RBAC: Authorizing `identity:get_group(group_id=c280db2914324552abb4de71f8fbf89c)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:41.253856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa62c0-6423-4f05-887c-f262268ebd3e None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:41.260077 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 222/454] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 16 00:11:41 2022] GET /identity/v3/groups/c280db2914324552abb4de71f8fbf89c => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:41.261606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca944a-11d3-4871-a174-e263442dbad0 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:41.363879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca944a-11d3-4871-a174-e263442dbad0 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:41.396947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74244c3-4826-4e49-8207-c2d179fb0b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:41.397595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74244c3-4826-4e49-8207-c2d179fb0b8a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:41.397881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74244c3-4826-4e49-8207-c2d179fb0b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:41.398158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74244c3-4826-4e49-8207-c2d179fb0b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:41.398978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74244c3-4826-4e49-8207-c2d179fb0b8a None admin] RBAC: Adding query filter params (group.id=c280db2914324552abb4de71f8fbf89c, role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=9f6ff6bbe76344e7a7f939e30a88483a) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:41.399291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74244c3-4826-4e49-8207-c2d179fb0b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:41.400748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74244c3-4826-4e49-8207-c2d179fb0b8a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:41.406354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 233/455] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 16 00:11:41 2022] GET /identity/v3/role_assignments?group.id=c280db2914324552abb4de71f8fbf89c&scope.project.id=9f6ff6bbe76344e7a7f939e30a88483a&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:43.920265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e576f-fefb-43e9-aca4-8eac237b6fc2 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:43.920785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e576f-fefb-43e9-aca4-8eac237b6fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:43.920861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e576f-fefb-43e9-aca4-8eac237b6fc2 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:43.922462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 223/456] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:43.928209 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0905d4-c043-4675-b6a3-a9a2efe3bef4 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:43.928613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0905d4-c043-4675-b6a3-a9a2efe3bef4 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:43.928779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0905d4-c043-4675-b6a3-a9a2efe3bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:43.945765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4d0905d4-c043-4675-b6a3-a9a2efe3bef4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:43.946962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4d0905d4-c043-4675-b6a3-a9a2efe3bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:43.993610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:44.024077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 234/457] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:44.043365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e576f-fefb-43e9-aca4-8eac237b6fc2 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:44.161788 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e576f-fefb-43e9-aca4-8eac237b6fc2 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:44.198720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9863378-6f77-4711-9fcc-9c183d6d7d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:44.199436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9863378-6f77-4711-9fcc-9c183d6d7d1b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:44.199720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9863378-6f77-4711-9fcc-9c183d6d7d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:44.200006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9863378-6f77-4711-9fcc-9c183d6d7d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:44.211117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9863378-6f77-4711-9fcc-9c183d6d7d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:44.212877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9863378-6f77-4711-9fcc-9c183d6d7d1b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-e9863378-6f77-4711-9fcc-9c183d6d7d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:44.237791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:44.239247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:44.240140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:44.240140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:44.240140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:44.240140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:44.240140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 224/458] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:44.242482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8e21-df85-4aeb-9143-c7ca1d20a8d1 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:44.242780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8e21-df85-4aeb-9143-c7ca1d20a8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:44.243058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8e21-df85-4aeb-9143-c7ca1d20a8d1 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:44.248819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 235/459] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:44.249808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9863378-6f77-4711-9fcc-9c183d6d7d1b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:44.254548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdce595-b3a6-454a-8613-b13ed454ffe4 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:44.254838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdce595-b3a6-454a-8613-b13ed454ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:44.255118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdce595-b3a6-454a-8613-b13ed454ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:44.280857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-bbdce595-b3a6-454a-8613-b13ed454ffe4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:44.282058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-bbdce595-b3a6-454a-8613-b13ed454ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:44.308355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:44.389330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9863378-6f77-4711-9fcc-9c183d6d7d1b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:44.429644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84b47-869f-4dab-b7c5-8cf170153e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:44.430617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84b47-869f-4dab-b7c5-8cf170153e29 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:44.430904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84b47-869f-4dab-b7c5-8cf170153e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:44.431185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a84b47-869f-4dab-b7c5-8cf170153e29 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:44.432277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a84b47-869f-4dab-b7c5-8cf170153e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:44.432590 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a84b47-869f-4dab-b7c5-8cf170153e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:44.434045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a84b47-869f-4dab-b7c5-8cf170153e29 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:44.453826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 225/460] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:44.455711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84b47-869f-4dab-b7c5-8cf170153e29 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:44.477400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 236/461] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:44.517854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdce595-b3a6-454a-8613-b13ed454ffe4 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:44.541390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:44.571493 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a84b47-869f-4dab-b7c5-8cf170153e29 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:44.614789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650b0e9-4ed3-4029-9178-1b638a661302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:44.615759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b0e9-4ed3-4029-9178-1b638a661302 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:44.616075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b0e9-4ed3-4029-9178-1b638a661302 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:44.616359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650b0e9-4ed3-4029-9178-1b638a661302 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:44.617099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650b0e9-4ed3-4029-9178-1b638a661302 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:44.619942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650b0e9-4ed3-4029-9178-1b638a661302 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:44.649655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 226/462] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:11:44 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:11:44.651684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a852a-3dd7-403a-9aa9-fec0df4e54aa None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:44.652000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a852a-3dd7-403a-9aa9-fec0df4e54aa None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:44.652289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a852a-3dd7-403a-9aa9-fec0df4e54aa None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:44.656052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 227/463] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:44.661496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2639b19-f906-48bb-9ba0-da1afb872052 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:44.662140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2639b19-f906-48bb-9ba0-da1afb872052 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:44.662621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2639b19-f906-48bb-9ba0-da1afb872052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:44.663513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdce595-b3a6-454a-8613-b13ed454ffe4 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:44.676347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:44.682742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c2639b19-f906-48bb-9ba0-da1afb872052 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:44.684347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c2639b19-f906-48bb-9ba0-da1afb872052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:44.705421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3011fc-fca2-4885-9261-6191ecc069af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:44.706151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3011fc-fca2-4885-9261-6191ecc069af None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:44.706430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3011fc-fca2-4885-9261-6191ecc069af None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:44.706702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3011fc-fca2-4885-9261-6191ecc069af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:44.719017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3011fc-fca2-4885-9261-6191ecc069af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:44.720799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3011fc-fca2-4885-9261-6191ecc069af None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-4b3011fc-fca2-4885-9261-6191ecc069af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:44.742119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:44.743128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:44.743998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:44.743998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:44.743998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:44.743998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:44.743998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 237/464] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:11:44.749199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e2d4-c2dd-492b-8b71-c9aab7e3f08d None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:44.749513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e2d4-c2dd-492b-8b71-c9aab7e3f08d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:44.749771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e2d4-c2dd-492b-8b71-c9aab7e3f08d None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:44.751380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 238/465] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:44.753283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443e2d4-c2dd-492b-8b71-c9aab7e3f08d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:44.770405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 228/466] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:44.772141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6ce2-3525-4841-a652-2e30dce3d41f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:44.772707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6ce2-3525-4841-a652-2e30dce3d41f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:44.773222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6ce2-3525-4841-a652-2e30dce3d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:44.792900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b70e6ce2-3525-4841-a652-2e30dce3d41f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:44.794553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b70e6ce2-3525-4841-a652-2e30dce3d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:44.857824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:44.872900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 229/467] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:44.873342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e6ce2-3525-4841-a652-2e30dce3d41f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:44.901010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443e2d4-c2dd-492b-8b71-c9aab7e3f08d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:44.940059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f1e45-4827-4924-af9f-482f22e872ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:44.940960 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f1e45-4827-4924-af9f-482f22e872ca None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:44.941292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f1e45-4827-4924-af9f-482f22e872ca None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:44.941573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f1e45-4827-4924-af9f-482f22e872ca None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:44.942581 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f1e45-4827-4924-af9f-482f22e872ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:44.942760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f1e45-4827-4924-af9f-482f22e872ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:44.944524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f1e45-4827-4924-af9f-482f22e872ca None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:44.963123 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 239/468] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:44.963903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f1e45-4827-4924-af9f-482f22e872ca None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:44.992396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:44.998289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e6ce2-3525-4841-a652-2e30dce3d41f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:45.047794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717170fc-4512-46fd-891d-2b9cb1ee58b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:45.048701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717170fc-4512-46fd-891d-2b9cb1ee58b7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:45.048990 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717170fc-4512-46fd-891d-2b9cb1ee58b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:45.049269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717170fc-4512-46fd-891d-2b9cb1ee58b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:45.060264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717170fc-4512-46fd-891d-2b9cb1ee58b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:45.061728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717170fc-4512-46fd-891d-2b9cb1ee58b7 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:45.078162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f1e45-4827-4924-af9f-482f22e872ca None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-717170fc-4512-46fd-891d-2b9cb1ee58b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:45.080156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:45.080976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:45.082345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:45.082345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:45.082345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:45.082345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:45.082564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 230/469] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:45.086864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717170fc-4512-46fd-891d-2b9cb1ee58b7 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:45.123592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dfb1a-f649-4708-9b4e-8a37378c5ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:45.124527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dfb1a-f649-4708-9b4e-8a37378c5ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:45.124874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dfb1a-f649-4708-9b4e-8a37378c5ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:45.125162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dfb1a-f649-4708-9b4e-8a37378c5ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:45.130449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:45.137776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dfb1a-f649-4708-9b4e-8a37378c5ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:45.139314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dfb1a-f649-4708-9b4e-8a37378c5ee5 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-a77dfb1a-f649-4708-9b4e-8a37378c5ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:45.158290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:45.159184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:45.160594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:45.160594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:45.160594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:45.160594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:45.165078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 240/470] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:45.165945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dfb1a-f649-4708-9b4e-8a37378c5ee5 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:45.207822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717170fc-4512-46fd-891d-2b9cb1ee58b7 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:45.248443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:45.255266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4bdb-aff7-4a52-9840-8a1756400113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:45.256602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4bdb-aff7-4a52-9840-8a1756400113 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:45.257253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4bdb-aff7-4a52-9840-8a1756400113 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:45.258039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4bdb-aff7-4a52-9840-8a1756400113 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:45.259240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce4bdb-aff7-4a52-9840-8a1756400113 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:45.261573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce4bdb-aff7-4a52-9840-8a1756400113 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:45.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dfb1a-f649-4708-9b4e-8a37378c5ee5 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:45.289532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 231/471] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:11:45 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:11:45.291385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4bdb-aff7-4a52-9840-8a1756400113 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:45.305851 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397de1c7-f6a1-4469-ab0d-a2c04965326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:45.306540 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397de1c7-f6a1-4469-ab0d-a2c04965326f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:45.306829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397de1c7-f6a1-4469-ab0d-a2c04965326f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:45.307112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397de1c7-f6a1-4469-ab0d-a2c04965326f None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:45.307856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397de1c7-f6a1-4469-ab0d-a2c04965326f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:45.308233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397de1c7-f6a1-4469-ab0d-a2c04965326f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:45.309745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397de1c7-f6a1-4469-ab0d-a2c04965326f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:45.334781 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 241/472] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:45.345034 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397de1c7-f6a1-4469-ab0d-a2c04965326f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:45.425015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:45.431097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4bdb-aff7-4a52-9840-8a1756400113 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:45.478108 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19a4e7-f6c6-44a4-935c-a5f751dc32a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:45.480156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a4e7-f6c6-44a4-935c-a5f751dc32a0 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:45.480658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a4e7-f6c6-44a4-935c-a5f751dc32a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:45.481141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a4e7-f6c6-44a4-935c-a5f751dc32a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:45.482158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19a4e7-f6c6-44a4-935c-a5f751dc32a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:45.482727 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19a4e7-f6c6-44a4-935c-a5f751dc32a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:45.484854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19a4e7-f6c6-44a4-935c-a5f751dc32a0 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:45.499089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 232/473] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:45.500950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f1442-dbb2-4439-ac1f-c75a23e130d5 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:45.501463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f1442-dbb2-4439-ac1f-c75a23e130d5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:45.501939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f1442-dbb2-4439-ac1f-c75a23e130d5 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:45.504372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 233/474] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:45.505386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f1442-dbb2-4439-ac1f-c75a23e130d5 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:45.558856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397de1c7-f6a1-4469-ab0d-a2c04965326f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:45.600185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:45.606812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd226170-6a06-4e17-9cfa-7923e907ed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:45.607000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd226170-6a06-4e17-9cfa-7923e907ed38 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:45.607188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd226170-6a06-4e17-9cfa-7923e907ed38 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:45.607444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd226170-6a06-4e17-9cfa-7923e907ed38 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:45.608960 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd226170-6a06-4e17-9cfa-7923e907ed38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:45.610536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd226170-6a06-4e17-9cfa-7923e907ed38 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:45.625873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f1442-dbb2-4439-ac1f-c75a23e130d5 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:45.634757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 242/475] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:11:45 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:11:45.635555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563d2eb-8998-48bf-986d-544aced4ba63 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:45.635555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563d2eb-8998-48bf-986d-544aced4ba63 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:45.635838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563d2eb-8998-48bf-986d-544aced4ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:45.660785 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e563d2eb-8998-48bf-986d-544aced4ba63 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:45.662079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e563d2eb-8998-48bf-986d-544aced4ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:45.747088 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 243/476] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:45.749035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8dce1-f143-46de-95cc-b0e014e30451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:45.749794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8dce1-f143-46de-95cc-b0e014e30451 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:45.750018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8dce1-f143-46de-95cc-b0e014e30451 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:45.750298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8dce1-f143-46de-95cc-b0e014e30451 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:45.751089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8dce1-f143-46de-95cc-b0e014e30451 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:45.752768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8dce1-f143-46de-95cc-b0e014e30451 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:45.777607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 234/477] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:11:45 2022] POST /identity/v3/users => generated 249 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:11:45.790907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563d2eb-8998-48bf-986d-544aced4ba63 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:45.917259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563d2eb-8998-48bf-986d-544aced4ba63 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:45.939031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:45.962805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dc3d0-2878-4737-8735-57bb6669e437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:45.963550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dc3d0-2878-4737-8735-57bb6669e437 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:45.963844 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dc3d0-2878-4737-8735-57bb6669e437 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:45.964350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dc3d0-2878-4737-8735-57bb6669e437 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:45.965210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dc3d0-2878-4737-8735-57bb6669e437 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:45.967022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dc3d0-2878-4737-8735-57bb6669e437 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:45.976521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.sql.core [None req-a05dc3d0-2878-4737-8735-57bb6669e437 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:11:45.976521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 00:11:45.976521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [parameters: {'id': '3101f868e1fc461fbf88daba0c447f91', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 00:11:45.976521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81054) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-a05dc3d0-2878-4737-8735-57bb6669e437 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application result.read() Jun 16 00:11:45.994203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:11:45.995117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application yield resource Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise self.value Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application session.commit() Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:11:45.996050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:11:45.996895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:11:45.997765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application result.read() Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:11:45.998615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [parameters: {'id': '3101f868e1fc461fbf88daba0c447f91', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:45.999401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 00:11:46.001766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:46.007054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 244/478] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jun 16 00:11:45 2022] POST /identity/v3/roles => generated 144 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:46.007200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8dce1-f143-46de-95cc-b0e014e30451 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:46.024630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:46.118041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8dce1-f143-46de-95cc-b0e014e30451 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:46.157641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a27846-f4a7-44b5-9771-b6704b40af03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:46.158832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27846-f4a7-44b5-9771-b6704b40af03 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:46.159126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27846-f4a7-44b5-9771-b6704b40af03 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:46.159406 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27846-f4a7-44b5-9771-b6704b40af03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:46.170376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a27846-f4a7-44b5-9771-b6704b40af03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-85a27846-f4a7-44b5-9771-b6704b40af03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:46.179694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:46.180776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:11:46.181568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:46.184209 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 235/479] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:11:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:46.189498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dc3d0-2878-4737-8735-57bb6669e437 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:46.344096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dc3d0-2878-4737-8735-57bb6669e437 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:46.396026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a8715-c99c-437b-a3bb-eaf856925a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:46.396710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8715-c99c-437b-a3bb-eaf856925a50 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:46.396999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8715-c99c-437b-a3bb-eaf856925a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:46.397284 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8715-c99c-437b-a3bb-eaf856925a50 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:46.398039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a8715-c99c-437b-a3bb-eaf856925a50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:46.398352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a8715-c99c-437b-a3bb-eaf856925a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:46.399838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a8715-c99c-437b-a3bb-eaf856925a50 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:46.411235 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 245/480] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:47.075926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b625f-13d3-458a-8c6a-0ac73232ea12 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:47.076454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b625f-13d3-458a-8c6a-0ac73232ea12 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:47.076526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b625f-13d3-458a-8c6a-0ac73232ea12 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:47.078143 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 236/481] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:47.083567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898560b-fa64-46af-be9e-081111632888 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:47.083951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898560b-fa64-46af-be9e-081111632888 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:47.084170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898560b-fa64-46af-be9e-081111632888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:47.105783 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-9898560b-fa64-46af-be9e-081111632888 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:47.106984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9898560b-fa64-46af-be9e-081111632888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:47.157903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:47.192308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 246/482] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:47.235532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b625f-13d3-458a-8c6a-0ac73232ea12 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:47.340040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:47.362423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b625f-13d3-458a-8c6a-0ac73232ea12 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:47.398354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb5610-3be8-4ed1-b507-d0e0cfde5adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:47.399168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb5610-3be8-4ed1-b507-d0e0cfde5adc None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:47.399457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb5610-3be8-4ed1-b507-d0e0cfde5adc None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:47.399741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb5610-3be8-4ed1-b507-d0e0cfde5adc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:47.410628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb5610-3be8-4ed1-b507-d0e0cfde5adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-3fcb5610-3be8-4ed1-b507-d0e0cfde5adc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:47.418600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:47.419607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:47.420426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 237/483] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:47.426353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898560b-fa64-46af-be9e-081111632888 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:47.528482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898560b-fa64-46af-be9e-081111632888 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:47.563304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958ba60-e829-4e00-8ca2-5ef75e4c6769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:47.564007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958ba60-e829-4e00-8ca2-5ef75e4c6769 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:47.564305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958ba60-e829-4e00-8ca2-5ef75e4c6769 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:47.564587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958ba60-e829-4e00-8ca2-5ef75e4c6769 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:47.565341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958ba60-e829-4e00-8ca2-5ef75e4c6769 None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:47.565655 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958ba60-e829-4e00-8ca2-5ef75e4c6769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:47.567603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958ba60-e829-4e00-8ca2-5ef75e4c6769 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:47.576330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 247/484] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:11:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:47.581740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb5610-3be8-4ed1-b507-d0e0cfde5adc None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:47.714919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb5610-3be8-4ed1-b507-d0e0cfde5adc None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:47.758746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21931def-021c-4b74-90ac-e0c97a69a3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:47.759554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931def-021c-4b74-90ac-e0c97a69a3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:47.759840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931def-021c-4b74-90ac-e0c97a69a3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:47.760157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931def-021c-4b74-90ac-e0c97a69a3b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:47.762181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:47.777778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21931def-021c-4b74-90ac-e0c97a69a3b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:47.779367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21931def-021c-4b74-90ac-e0c97a69a3b5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-21931def-021c-4b74-90ac-e0c97a69a3b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:47.803593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:47.804572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:47.805514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:47.805514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:47.805514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:47.805514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:47.805514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 238/485] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:47.810708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958ba60-e829-4e00-8ca2-5ef75e4c6769 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:47.855444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:47.870952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8bda-4377-4dc5-9fc8-9cf15912af53 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:47.871249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8bda-4377-4dc5-9fc8-9cf15912af53 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:47.871522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8bda-4377-4dc5-9fc8-9cf15912af53 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:47.873041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 239/486] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:47.878127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06af2e-a189-406e-b584-f8cbc1d2b723 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:47.878420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06af2e-a189-406e-b584-f8cbc1d2b723 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:47.878752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06af2e-a189-406e-b584-f8cbc1d2b723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:47.904511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4d06af2e-a189-406e-b584-f8cbc1d2b723 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:47.905716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4d06af2e-a189-406e-b584-f8cbc1d2b723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:47.981916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958ba60-e829-4e00-8ca2-5ef75e4c6769 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:48.052300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837e040-0414-4120-8f44-cb4105276b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:48.052976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837e040-0414-4120-8f44-cb4105276b62 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:48.053266 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837e040-0414-4120-8f44-cb4105276b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:48.053547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837e040-0414-4120-8f44-cb4105276b62 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:48.054281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837e040-0414-4120-8f44-cb4105276b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:48.054593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837e040-0414-4120-8f44-cb4105276b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:48.056003 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837e040-0414-4120-8f44-cb4105276b62 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:48.062814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 240/487] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:11:48.079341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 248/488] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:48.085638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06af2e-a189-406e-b584-f8cbc1d2b723 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:48.088951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837e040-0414-4120-8f44-cb4105276b62 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:48.200315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06af2e-a189-406e-b584-f8cbc1d2b723 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:48.240085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:48.241732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b9e95-f411-45fa-a029-417dc9286ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:48.242425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b9e95-f411-45fa-a029-417dc9286ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:48.245145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b9e95-f411-45fa-a029-417dc9286ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:48.245524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b9e95-f411-45fa-a029-417dc9286ec0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:48.262046 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b9e95-f411-45fa-a029-417dc9286ec0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:48.263427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b9e95-f411-45fa-a029-417dc9286ec0 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:48.288473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:48.295463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837e040-0414-4120-8f44-cb4105276b62 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-518b9e95-f411-45fa-a029-417dc9286ec0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:11:48.305997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:48.307153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:48.308288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:48.308288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:48.308288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:11:48.308288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:11:48.308288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:11:48.308288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:11:48.308288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:11:48.308288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:11:48.308288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:11:48.308288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:48.310779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 241/489] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 16 00:11:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:48.316850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b9e95-f411-45fa-a029-417dc9286ec0 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:48.350133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453d3f3-5676-45c5-957f-55cb8cfbfe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:48.351188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453d3f3-5676-45c5-957f-55cb8cfbfe64 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:48.351477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453d3f3-5676-45c5-957f-55cb8cfbfe64 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:48.351760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453d3f3-5676-45c5-957f-55cb8cfbfe64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:48.364199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453d3f3-5676-45c5-957f-55cb8cfbfe64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-b453d3f3-5676-45c5-957f-55cb8cfbfe64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:48.372832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:48.373718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:48.374686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 249/490] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:48.380654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453d3f3-5676-45c5-957f-55cb8cfbfe64 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:48.507221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453d3f3-5676-45c5-957f-55cb8cfbfe64 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:48.541091 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b9e95-f411-45fa-a029-417dc9286ec0 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:48.552061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0426f-5e4c-4a8e-8817-0ed8d8603c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:48.552742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0426f-5e4c-4a8e-8817-0ed8d8603c03 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:48.553031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0426f-5e4c-4a8e-8817-0ed8d8603c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:48.553312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0426f-5e4c-4a8e-8817-0ed8d8603c03 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:48.554485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0426f-5e4c-4a8e-8817-0ed8d8603c03 None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:48.554803 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0426f-5e4c-4a8e-8817-0ed8d8603c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:48.556513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0426f-5e4c-4a8e-8817-0ed8d8603c03 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:48.568091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 250/491] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:11:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:48.569706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9967c6-a39b-4dbe-ba17-2900f3cd8ffc None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:48.569993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9967c6-a39b-4dbe-ba17-2900f3cd8ffc None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:48.570282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9967c6-a39b-4dbe-ba17-2900f3cd8ffc None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:48.575788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 251/492] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:48.575788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9967c6-a39b-4dbe-ba17-2900f3cd8ffc None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:48.584525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7119bb-e8a2-4103-a85b-759bfef6d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:48.585510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7119bb-e8a2-4103-a85b-759bfef6d094 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:48.585998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7119bb-e8a2-4103-a85b-759bfef6d094 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:48.586475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7119bb-e8a2-4103-a85b-759bfef6d094 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:48.587534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7119bb-e8a2-4103-a85b-759bfef6d094 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:48.588219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7119bb-e8a2-4103-a85b-759bfef6d094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:48.590002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7119bb-e8a2-4103-a85b-759bfef6d094 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:48.597022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:48.641018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 242/493] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 16 00:11:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:48.642833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf6e6c-d961-4515-b2ef-93c5606feb7d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:48.643352 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf6e6c-d961-4515-b2ef-93c5606feb7d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:48.643831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf6e6c-d961-4515-b2ef-93c5606feb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:48.663258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-1fbf6e6c-d961-4515-b2ef-93c5606feb7d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:48.664792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1fbf6e6c-d961-4515-b2ef-93c5606feb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:48.695981 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9967c6-a39b-4dbe-ba17-2900f3cd8ffc None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:48.696304 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:48.734850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a5d6b-5835-4ab4-98a4-5693ed477f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:48.735678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a5d6b-5835-4ab4-98a4-5693ed477f7e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:48.735987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a5d6b-5835-4ab4-98a4-5693ed477f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:48.736268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a5d6b-5835-4ab4-98a4-5693ed477f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:48.744032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 243/494] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:48.745100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf6e6c-d961-4515-b2ef-93c5606feb7d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:48.759086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a5d6b-5835-4ab4-98a4-5693ed477f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:48.760940 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a5d6b-5835-4ab4-98a4-5693ed477f7e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-371a5d6b-5835-4ab4-98a4-5693ed477f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:48.779911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:48.780931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:48.781811 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:48.781811 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:48.781811 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:48.781811 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:48.781811 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 252/495] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:48.782587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662be7-d46e-4334-b89b-c1bb15086301 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:48.782672 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662be7-d46e-4334-b89b-c1bb15086301 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:48.782888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662be7-d46e-4334-b89b-c1bb15086301 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:48.784526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 253/496] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:48.789412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85662be7-d46e-4334-b89b-c1bb15086301 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:48.861264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf6e6c-d961-4515-b2ef-93c5606feb7d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:48.865079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:48.897392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa662cf-af36-4068-b970-70bb7678250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:48.898222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa662cf-af36-4068-b970-70bb7678250c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:48.898625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa662cf-af36-4068-b970-70bb7678250c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:48.898789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85662be7-d46e-4334-b89b-c1bb15086301 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:48.899088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa662cf-af36-4068-b970-70bb7678250c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:48.933401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:48.935151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d18257-92ca-41b4-884f-4775ac258aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:48.935948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d18257-92ca-41b4-884f-4775ac258aae None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:48.936257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d18257-92ca-41b4-884f-4775ac258aae None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:48.936532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d18257-92ca-41b4-884f-4775ac258aae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:48.947455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d18257-92ca-41b4-884f-4775ac258aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-51d18257-92ca-41b4-884f-4775ac258aae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:48.955199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:48.956278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:48.957610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 254/497] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:48.958258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d18257-92ca-41b4-884f-4775ac258aae None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:48.979733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa662cf-af36-4068-b970-70bb7678250c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:48.981791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa662cf-af36-4068-b970-70bb7678250c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:49.068495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d18257-92ca-41b4-884f-4775ac258aae None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:49.099148 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 244/498] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:49.100477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d70a4-a71d-4191-8ffb-a33dc1b91b65 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.100768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d70a4-a71d-4191-8ffb-a33dc1b91b65 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.101049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d70a4-a71d-4191-8ffb-a33dc1b91b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.105245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:49.111912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfe0c3-c5da-49b7-9b4e-d55fae09bc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:49.112631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfe0c3-c5da-49b7-9b4e-d55fae09bc02 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.112937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfe0c3-c5da-49b7-9b4e-d55fae09bc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.113232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfe0c3-c5da-49b7-9b4e-d55fae09bc02 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.113952 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfe0c3-c5da-49b7-9b4e-d55fae09bc02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:49.114263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfe0c3-c5da-49b7-9b4e-d55fae09bc02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:49.115643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfe0c3-c5da-49b7-9b4e-d55fae09bc02 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:49.119152 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b21d70a4-a71d-4191-8ffb-a33dc1b91b65 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:49.120591 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b21d70a4-a71d-4191-8ffb-a33dc1b91b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:49.128472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 255/499] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:49.130049 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfe0c3-c5da-49b7-9b4e-d55fae09bc02 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:49.187921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:49.197635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 245/500] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:49.198288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d70a4-a71d-4191-8ffb-a33dc1b91b65 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:49.259340 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfe0c3-c5da-49b7-9b4e-d55fae09bc02 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:49.302610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c31f6-6bbb-413f-81cf-d39337b96c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:49.303197 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c31f6-6bbb-413f-81cf-d39337b96c6d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.303497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c31f6-6bbb-413f-81cf-d39337b96c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.303754 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c31f6-6bbb-413f-81cf-d39337b96c6d None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.304529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c31f6-6bbb-413f-81cf-d39337b96c6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:49.304839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c31f6-6bbb-413f-81cf-d39337b96c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:49.305646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d70a4-a71d-4191-8ffb-a33dc1b91b65 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:49.306218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c31f6-6bbb-413f-81cf-d39337b96c6d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:49.319213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 256/501] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:11:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:49.319213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c31f6-6bbb-413f-81cf-d39337b96c6d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:49.346849 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49571274-5e01-4248-9847-adc4a83d7a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:49.347649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571274-5e01-4248-9847-adc4a83d7a7a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.347938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571274-5e01-4248-9847-adc4a83d7a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.348247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571274-5e01-4248-9847-adc4a83d7a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.358337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49571274-5e01-4248-9847-adc4a83d7a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:49.359776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49571274-5e01-4248-9847-adc4a83d7a7a None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:49.371875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-49571274-5e01-4248-9847-adc4a83d7a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:49.377179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:49.378024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:49.379415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:49.379415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:49.379415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:49.379415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:49.379415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 246/502] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:49.379682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49571274-5e01-4248-9847-adc4a83d7a7a None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:49.422969 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c31f6-6bbb-413f-81cf-d39337b96c6d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:49.428219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:49.458905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e43d7f-5e9d-44ae-8702-1121370af44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:49.459698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e43d7f-5e9d-44ae-8702-1121370af44e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.460008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e43d7f-5e9d-44ae-8702-1121370af44e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.460292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e43d7f-5e9d-44ae-8702-1121370af44e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.467881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e43d7f-5e9d-44ae-8702-1121370af44e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:49.469349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e43d7f-5e9d-44ae-8702-1121370af44e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:49.481307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49571274-5e01-4248-9847-adc4a83d7a7a None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-b1e43d7f-5e9d-44ae-8702-1121370af44e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:11:49.484571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:49.485693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 257/503] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:49.486595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e43d7f-5e9d-44ae-8702-1121370af44e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:49.516668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1403094-c5b9-42b9-b57c-52a4421ceb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:49.517463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1403094-c5b9-42b9-b57c-52a4421ceb4f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.517749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1403094-c5b9-42b9-b57c-52a4421ceb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.518023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1403094-c5b9-42b9-b57c-52a4421ceb4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.527897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1403094-c5b9-42b9-b57c-52a4421ceb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-a1403094-c5b9-42b9-b57c-52a4421ceb4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:49.535688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:49.536755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:49.537577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 247/504] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:49.538430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164826c-fb68-4b19-b087-e102eb843ae4 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.538626 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164826c-fb68-4b19-b087-e102eb843ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.538907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164826c-fb68-4b19-b087-e102eb843ae4 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.540171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 248/505] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:49.540864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164826c-fb68-4b19-b087-e102eb843ae4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:49.598412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e43d7f-5e9d-44ae-8702-1121370af44e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:49.610581 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:49.632384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c81400-6b26-43ef-aff8-9bd107f7e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:49.633180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c81400-6b26-43ef-aff8-9bd107f7e576 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.633467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c81400-6b26-43ef-aff8-9bd107f7e576 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.633741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c81400-6b26-43ef-aff8-9bd107f7e576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.642500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164826c-fb68-4b19-b087-e102eb843ae4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:49.644172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c81400-6b26-43ef-aff8-9bd107f7e576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:49.645621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c81400-6b26-43ef-aff8-9bd107f7e576 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:49.649225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-46c81400-6b26-43ef-aff8-9bd107f7e576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:49.662216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:49.663222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:49.664086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:49.664086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:49.664086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:49.664086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:49.664086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 258/506] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:49.664368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c81400-6b26-43ef-aff8-9bd107f7e576 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:49.682835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046bcc1-d369-4670-b06d-92f6a2f3b024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:49.683494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046bcc1-d369-4670-b06d-92f6a2f3b024 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.683779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046bcc1-d369-4670-b06d-92f6a2f3b024 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.684089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046bcc1-d369-4670-b06d-92f6a2f3b024 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.684811 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046bcc1-d369-4670-b06d-92f6a2f3b024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:49.685123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046bcc1-d369-4670-b06d-92f6a2f3b024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:49.686493 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046bcc1-d369-4670-b06d-92f6a2f3b024 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:49.698044 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 249/507] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:49.698821 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046bcc1-d369-4670-b06d-92f6a2f3b024 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:49.761770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c81400-6b26-43ef-aff8-9bd107f7e576 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:49.795141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c670fe-44f5-4979-8759-0abef6635186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:49.795800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c670fe-44f5-4979-8759-0abef6635186 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.796112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c670fe-44f5-4979-8759-0abef6635186 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.796241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046bcc1-d369-4670-b06d-92f6a2f3b024 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:49.796387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c670fe-44f5-4979-8759-0abef6635186 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.797213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c670fe-44f5-4979-8759-0abef6635186 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:49.797525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c670fe-44f5-4979-8759-0abef6635186 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:49.798958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c670fe-44f5-4979-8759-0abef6635186 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:49.828169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9e603-cba5-4518-a9f3-c7b64659a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:49.828833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e603-cba5-4518-a9f3-c7b64659a7de None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.829118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e603-cba5-4518-a9f3-c7b64659a7de None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.829399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e603-cba5-4518-a9f3-c7b64659a7de None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.830140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9e603-cba5-4518-a9f3-c7b64659a7de None admin] RBAC: Adding query filter params (name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:49.830452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9e603-cba5-4518-a9f3-c7b64659a7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:49.832336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9e603-cba5-4518-a9f3-c7b64659a7de None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:49.834951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 259/508] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 16 00:11:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:49.836202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537c27d-542c-4382-a1a2-62652471d1d1 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.836493 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537c27d-542c-4382-a1a2-62652471d1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.836769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537c27d-542c-4382-a1a2-62652471d1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.840331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 250/509] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:11:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:49.841378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9e603-cba5-4518-a9f3-c7b64659a7de None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:49.856592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-1537c27d-542c-4382-a1a2-62652471d1d1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:49.857713 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-1537c27d-542c-4382-a1a2-62652471d1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:49.868834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:49.874072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:49.923023 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 260/510] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:49.923722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537c27d-542c-4382-a1a2-62652471d1d1 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:49.940033 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9e603-cba5-4518-a9f3-c7b64659a7de None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:49.975327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a4a1-0a25-417f-9bfb-09d5d5f02983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:49.976008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a4a1-0a25-417f-9bfb-09d5d5f02983 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:49.976301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a4a1-0a25-417f-9bfb-09d5d5f02983 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:49.976579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a4a1-0a25-417f-9bfb-09d5d5f02983 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:49.977299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998a4a1-0a25-417f-9bfb-09d5d5f02983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:49.977610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998a4a1-0a25-417f-9bfb-09d5d5f02983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:49.979208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998a4a1-0a25-417f-9bfb-09d5d5f02983 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:49.990943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 251/511] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:49.991725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a4a1-0a25-417f-9bfb-09d5d5f02983 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.028383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537c27d-542c-4382-a1a2-62652471d1d1 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:50.061586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c80ed-319d-48d0-b1d9-d683881f9b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:50.062402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c80ed-319d-48d0-b1d9-d683881f9b92 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:50.062687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c80ed-319d-48d0-b1d9-d683881f9b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:50.062964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c80ed-319d-48d0-b1d9-d683881f9b92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:50.069934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c80ed-319d-48d0-b1d9-d683881f9b92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:50.071389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c80ed-319d-48d0-b1d9-d683881f9b92 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:50.077079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-af8c80ed-319d-48d0-b1d9-d683881f9b92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:11:50.086128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:50.086959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:50.087786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:11:50.087786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:11:50.087786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:11:50.087786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:11:50.087786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:11:50.087786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:11:50.087786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:50.087786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:50.087786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 261/512] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:50.088288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c80ed-319d-48d0-b1d9-d683881f9b92 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.095703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a4a1-0a25-417f-9bfb-09d5d5f02983 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:50.102748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:50.129371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e3c04-12d9-42f6-ae66-a09e2f47b954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:50.129945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e3c04-12d9-42f6-ae66-a09e2f47b954 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:50.130229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e3c04-12d9-42f6-ae66-a09e2f47b954 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:50.130498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e3c04-12d9-42f6-ae66-a09e2f47b954 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:50.185489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c80ed-319d-48d0-b1d9-d683881f9b92 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:50.196576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e3c04-12d9-42f6-ae66-a09e2f47b954 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:50.198018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e3c04-12d9-42f6-ae66-a09e2f47b954 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:50.221861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9195cb-6eb9-4ac2-8054-31d50035516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:50.222658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9195cb-6eb9-4ac2-8054-31d50035516d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:50.222941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9195cb-6eb9-4ac2-8054-31d50035516d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:50.223217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9195cb-6eb9-4ac2-8054-31d50035516d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:50.233590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9195cb-6eb9-4ac2-8054-31d50035516d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:50.235044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9195cb-6eb9-4ac2-8054-31d50035516d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-3a9195cb-6eb9-4ac2-8054-31d50035516d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:50.253181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:50.254588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:50.255412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:50.255412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:50.255412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:50.255412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:50.255412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 262/513] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:50.255865 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9195cb-6eb9-4ac2-8054-31d50035516d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.284574 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:50.297756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 252/514] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:50.298674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e3c04-12d9-42f6-ae66-a09e2f47b954 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.320806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:50.358510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9195cb-6eb9-4ac2-8054-31d50035516d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:50.391091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb3503-ae3c-49e3-a6c5-25dc78722e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:50.391814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb3503-ae3c-49e3-a6c5-25dc78722e3b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:50.392134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb3503-ae3c-49e3-a6c5-25dc78722e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:50.392417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb3503-ae3c-49e3-a6c5-25dc78722e3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:50.396617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e3c04-12d9-42f6-ae66-a09e2f47b954 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:50.403289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb3503-ae3c-49e3-a6c5-25dc78722e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:50.404775 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb3503-ae3c-49e3-a6c5-25dc78722e3b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-12bb3503-ae3c-49e3-a6c5-25dc78722e3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:50.422010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:50.422987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:50.423834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:50.423834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:50.423834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:50.423834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:50.423834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 263/515] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:50.424129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb3503-ae3c-49e3-a6c5-25dc78722e3b None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.436944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef355d7-71df-427a-94ef-1eaa0cd4df71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:50.437741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef355d7-71df-427a-94ef-1eaa0cd4df71 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:50.438027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef355d7-71df-427a-94ef-1eaa0cd4df71 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:50.438305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef355d7-71df-427a-94ef-1eaa0cd4df71 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:50.446029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef355d7-71df-427a-94ef-1eaa0cd4df71 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:50.447672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef355d7-71df-427a-94ef-1eaa0cd4df71 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-5ef355d7-71df-427a-94ef-1eaa0cd4df71 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:11:50.462584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:50.463475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:50.464403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:50.464403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:50.464403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:11:50.464403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:11:50.464403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:11:50.464403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:11:50.464403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:11:50.464403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:11:50.464403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:11:50.464403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:50.464403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 253/516] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:50.464952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef355d7-71df-427a-94ef-1eaa0cd4df71 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.516093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:50.523696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb3503-ae3c-49e3-a6c5-25dc78722e3b None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:50.541496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:50.564495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce2520-09a5-4798-a236-1f5a7d390aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:50.565592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce2520-09a5-4798-a236-1f5a7d390aad None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:50.565982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce2520-09a5-4798-a236-1f5a7d390aad None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:50.566918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce2520-09a5-4798-a236-1f5a7d390aad None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:50.568161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce2520-09a5-4798-a236-1f5a7d390aad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:50.569005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce2520-09a5-4798-a236-1f5a7d390aad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:50.571021 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce2520-09a5-4798-a236-1f5a7d390aad None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:50.577668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef355d7-71df-427a-94ef-1eaa0cd4df71 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:50.591754 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 264/517] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:11:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:50.592723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce2520-09a5-4798-a236-1f5a7d390aad None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.618797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7afcee-2a84-4505-8f25-41d4154a09b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:50.619728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7afcee-2a84-4505-8f25-41d4154a09b9 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:50.620424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7afcee-2a84-4505-8f25-41d4154a09b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:50.620875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7afcee-2a84-4505-8f25-41d4154a09b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:50.621794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7afcee-2a84-4505-8f25-41d4154a09b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:50.622276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7afcee-2a84-4505-8f25-41d4154a09b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:50.623896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7afcee-2a84-4505-8f25-41d4154a09b9 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:50.638066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 254/518] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:50.639445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7afcee-2a84-4505-8f25-41d4154a09b9 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.699600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce2520-09a5-4798-a236-1f5a7d390aad None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:50.736680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a259e-4b33-4502-81a7-4a559df83912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:50.737477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a259e-4b33-4502-81a7-4a559df83912 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:50.737758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a259e-4b33-4502-81a7-4a559df83912 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:50.738586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a259e-4b33-4502-81a7-4a559df83912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:50.744411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7afcee-2a84-4505-8f25-41d4154a09b9 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:50.749575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a259e-4b33-4502-81a7-4a559df83912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:50.751038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a259e-4b33-4502-81a7-4a559df83912 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:50.755024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-5c6a259e-4b33-4502-81a7-4a559df83912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:50.769768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:50.770676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:50.771499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:50.771499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:50.771499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:50.771499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:50.771499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 265/519] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:50.772921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a259e-4b33-4502-81a7-4a559df83912 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.789855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205e4a9-84a3-4161-ac08-1c1b36e2f101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:50.790527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e4a9-84a3-4161-ac08-1c1b36e2f101 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:50.790802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e4a9-84a3-4161-ac08-1c1b36e2f101 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:50.791087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205e4a9-84a3-4161-ac08-1c1b36e2f101 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:50.792186 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205e4a9-84a3-4161-ac08-1c1b36e2f101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:50.792501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205e4a9-84a3-4161-ac08-1c1b36e2f101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:50.793876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205e4a9-84a3-4161-ac08-1c1b36e2f101 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:50.810932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 255/520] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:50.811105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:50.811197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205e4a9-84a3-4161-ac08-1c1b36e2f101 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.886190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a259e-4b33-4502-81a7-4a559df83912 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:50.907261 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205e4a9-84a3-4161-ac08-1c1b36e2f101 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:50.918690 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6763ab-c764-4ca7-84f9-c7fafccbd5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:50.919350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6763ab-c764-4ca7-84f9-c7fafccbd5ae None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:50.919634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6763ab-c764-4ca7-84f9-c7fafccbd5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:50.919905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6763ab-c764-4ca7-84f9-c7fafccbd5ae None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:50.920765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6763ab-c764-4ca7-84f9-c7fafccbd5ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:50.921075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6763ab-c764-4ca7-84f9-c7fafccbd5ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:50.922507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6763ab-c764-4ca7-84f9-c7fafccbd5ae None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:50.939257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 266/521] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Jun 16 00:11:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:50.940061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6763ab-c764-4ca7-84f9-c7fafccbd5ae None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.940948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e9c75-1400-49a3-bcf4-a961b9a3e870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:50.941634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e9c75-1400-49a3-bcf4-a961b9a3e870 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:50.941924 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e9c75-1400-49a3-bcf4-a961b9a3e870 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:50.942203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e9c75-1400-49a3-bcf4-a961b9a3e870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:50.943040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e9c75-1400-49a3-bcf4-a961b9a3e870 None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=cd57046b084b463488296b825097081d) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:50.943355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e9c75-1400-49a3-bcf4-a961b9a3e870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:50.944828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e9c75-1400-49a3-bcf4-a961b9a3e870 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:50.964242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 256/522] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:50 2022] GET /identity/v3/role_assignments?user.id=cd57046b084b463488296b825097081d&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:50.964242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e9c75-1400-49a3-bcf4-a961b9a3e870 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:50.999503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:51.037350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:51.056287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6763ab-c764-4ca7-84f9-c7fafccbd5ae None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:51.089407 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e9c75-1400-49a3-bcf4-a961b9a3e870 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:51.093441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4e904-c62d-476b-ba74-64ce4856cb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:51.094470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4e904-c62d-476b-ba74-64ce4856cb8d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:51.094761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4e904-c62d-476b-ba74-64ce4856cb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:51.095039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4e904-c62d-476b-ba74-64ce4856cb8d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:51.105614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4e904-c62d-476b-ba74-64ce4856cb8d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:51.107083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4e904-c62d-476b-ba74-64ce4856cb8d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-0ab4e904-c62d-476b-ba74-64ce4856cb8d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:11:51.123308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:51.124615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:51.125526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:51.125526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:51.125526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:11:51.125526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:11:51.125526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:11:51.125526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:11:51.125526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:11:51.125526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:11:51.125526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:11:51.125526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:51.125526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 267/523] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:51.126097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4e904-c62d-476b-ba74-64ce4856cb8d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:51.143781 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc64fb2-1a67-482a-95d0-69d4c19aeba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:51.144513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc64fb2-1a67-482a-95d0-69d4c19aeba1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:51.144800 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc64fb2-1a67-482a-95d0-69d4c19aeba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:51.145078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc64fb2-1a67-482a-95d0-69d4c19aeba1 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:51.145808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc64fb2-1a67-482a-95d0-69d4c19aeba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:51.146120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc64fb2-1a67-482a-95d0-69d4c19aeba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:51.147510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc64fb2-1a67-482a-95d0-69d4c19aeba1 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:51.163359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 257/524] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:51.163359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc64fb2-1a67-482a-95d0-69d4c19aeba1 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:51.241539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4e904-c62d-476b-ba74-64ce4856cb8d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:51.261524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:51.271488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc64fb2-1a67-482a-95d0-69d4c19aeba1 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:51.277395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e87166-227a-4926-8550-0f002209cb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:51.278076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e87166-227a-4926-8550-0f002209cb06 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:51.278363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e87166-227a-4926-8550-0f002209cb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:51.278652 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e87166-227a-4926-8550-0f002209cb06 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:51.279384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e87166-227a-4926-8550-0f002209cb06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:51.280864 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e87166-227a-4926-8550-0f002209cb06 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:51.300981 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 268/525] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:11:51 2022] POST /identity/v3/users => generated 247 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:11:51.301814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e87166-227a-4926-8550-0f002209cb06 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:51.315544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:51.318337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd074d-901a-4b53-825b-06bb642864b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:51.318894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd074d-901a-4b53-825b-06bb642864b2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:51.320369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd074d-901a-4b53-825b-06bb642864b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:51.320935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd074d-901a-4b53-825b-06bb642864b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:51.418197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd074d-901a-4b53-825b-06bb642864b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:51.420093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd074d-901a-4b53-825b-06bb642864b2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:51.460970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e87166-227a-4926-8550-0f002209cb06 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:51.507098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2f92e-5139-499b-8ff7-42b6f860b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:51.508720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f92e-5139-499b-8ff7-42b6f860b177 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:51.508720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f92e-5139-499b-8ff7-42b6f860b177 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:51.508720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f92e-5139-499b-8ff7-42b6f860b177 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:51.512598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2f92e-5139-499b-8ff7-42b6f860b177 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:51.512598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2f92e-5139-499b-8ff7-42b6f860b177 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:51.512598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2f92e-5139-499b-8ff7-42b6f860b177 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:51.522764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:51.535905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 269/526] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 16 00:11:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:51.537090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2f92e-5139-499b-8ff7-42b6f860b177 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:51.544522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 258/527] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:51.546754 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd074d-901a-4b53-825b-06bb642864b2 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:51.608532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:51.653736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2f92e-5139-499b-8ff7-42b6f860b177 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:51.682934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd074d-901a-4b53-825b-06bb642864b2 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:51.698577 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a293-b1bb-4c5b-a4c9-bf8e0f960d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:51.699638 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a293-b1bb-4c5b-a4c9-bf8e0f960d53 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:51.699931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a293-b1bb-4c5b-a4c9-bf8e0f960d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:51.700242 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a293-b1bb-4c5b-a4c9-bf8e0f960d53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:51.709844 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406a293-b1bb-4c5b-a4c9-bf8e0f960d53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:51.712048 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406a293-b1bb-4c5b-a4c9-bf8e0f960d53 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:51.723025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46488e41-652c-4f6c-b2ae-0ec5057b8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:51.723998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488e41-652c-4f6c-b2ae-0ec5057b8531 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:51.724499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488e41-652c-4f6c-b2ae-0ec5057b8531 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:51.724968 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488e41-652c-4f6c-b2ae-0ec5057b8531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-c406a293-b1bb-4c5b-a4c9-bf8e0f960d53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:11:51.730882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:51.731817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:51.732995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:11:51.732995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:11:51.732995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:11:51.732995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:11:51.732995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:11:51.732995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:11:51.732995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:51.732995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:51.732995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 270/528] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:51.733704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a293-b1bb-4c5b-a4c9-bf8e0f960d53 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:51.792044 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:51.803295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46488e41-652c-4f6c-b2ae-0ec5057b8531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:51.805056 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46488e41-652c-4f6c-b2ae-0ec5057b8531 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:51.870246 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a293-b1bb-4c5b-a4c9-bf8e0f960d53 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:51.890983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:51.906815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21d98f-3f31-4d29-aaa6-a3185ccce830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:51.907873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21d98f-3f31-4d29-aaa6-a3185ccce830 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:51.908322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21d98f-3f31-4d29-aaa6-a3185ccce830 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:51.908762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21d98f-3f31-4d29-aaa6-a3185ccce830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:51.920363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21d98f-3f31-4d29-aaa6-a3185ccce830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:51.921969 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21d98f-3f31-4d29-aaa6-a3185ccce830 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:51.936372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 259/529] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-6a21d98f-3f31-4d29-aaa6-a3185ccce830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:51.939838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:51.940729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:51.941622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:51.941622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:51.941622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:51.941622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:51.941837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46488e41-652c-4f6c-b2ae-0ec5057b8531 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:51.943512 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 271/530] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:51.951649 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21d98f-3f31-4d29-aaa6-a3185ccce830 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:52.057352 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:52.069023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46488e41-652c-4f6c-b2ae-0ec5057b8531 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:52.073219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21d98f-3f31-4d29-aaa6-a3185ccce830 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:52.109970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f005a9-119f-4621-9e9f-01697fa30386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:52.110884 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f005a9-119f-4621-9e9f-01697fa30386 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:52.111317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f005a9-119f-4621-9e9f-01697fa30386 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:52.111741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f005a9-119f-4621-9e9f-01697fa30386 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:52.112851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f005a9-119f-4621-9e9f-01697fa30386 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:52.113343 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f005a9-119f-4621-9e9f-01697fa30386 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:52.115028 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f005a9-119f-4621-9e9f-01697fa30386 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:52.123599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34232fad-f299-4b24-b7b3-febdea520f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:52.124977 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34232fad-f299-4b24-b7b3-febdea520f23 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:52.125546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34232fad-f299-4b24-b7b3-febdea520f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:52.126082 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34232fad-f299-4b24-b7b3-febdea520f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:52.144941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34232fad-f299-4b24-b7b3-febdea520f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:52.144941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34232fad-f299-4b24-b7b3-febdea520f23 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:52.145336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 260/531] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:52.147495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f005a9-119f-4621-9e9f-01697fa30386 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-34232fad-f299-4b24-b7b3-febdea520f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:52.166075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:52.167013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:52.167861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:52.167861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:52.167861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:52.167861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:52.167861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 272/532] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:52.168914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34232fad-f299-4b24-b7b3-febdea520f23 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:52.196430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:52.263285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f005a9-119f-4621-9e9f-01697fa30386 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:52.279593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34232fad-f299-4b24-b7b3-febdea520f23 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:52.302785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3826a-1002-4b2a-a53b-45185217fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:52.303637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3826a-1002-4b2a-a53b-45185217fd8c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:52.304228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3826a-1002-4b2a-a53b-45185217fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:52.304653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3826a-1002-4b2a-a53b-45185217fd8c None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:52.305620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3826a-1002-4b2a-a53b-45185217fd8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:52.306130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3826a-1002-4b2a-a53b-45185217fd8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:52.307806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3826a-1002-4b2a-a53b-45185217fd8c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:52.320438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 261/533] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:52.321404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3826a-1002-4b2a-a53b-45185217fd8c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:52.324679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fde20-1510-4d66-8a5c-62321371c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:52.325490 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fde20-1510-4d66-8a5c-62321371c928 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:52.326258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fde20-1510-4d66-8a5c-62321371c928 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:52.326708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fde20-1510-4d66-8a5c-62321371c928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:52.327691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fde20-1510-4d66-8a5c-62321371c928 None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=7ee61aece9c64e74806248e4ac49cd47) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:52.328459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fde20-1510-4d66-8a5c-62321371c928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:52.330987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fde20-1510-4d66-8a5c-62321371c928 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:52.343935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 273/534] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:52 2022] GET /identity/v3/role_assignments?user.id=7ee61aece9c64e74806248e4ac49cd47&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:52.343935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fde20-1510-4d66-8a5c-62321371c928 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:52.349241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:52.488566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:52.502988 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fde20-1510-4d66-8a5c-62321371c928 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:52.540320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c250381-af73-4a62-b171-4648f4cf5d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:52.541282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c250381-af73-4a62-b171-4648f4cf5d9c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:52.541671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c250381-af73-4a62-b171-4648f4cf5d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:52.542055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c250381-af73-4a62-b171-4648f4cf5d9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:52.549174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c250381-af73-4a62-b171-4648f4cf5d9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:52.550976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c250381-af73-4a62-b171-4648f4cf5d9c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:52.558317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3826a-1002-4b2a-a53b-45185217fd8c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-2c250381-af73-4a62-b171-4648f4cf5d9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:11:52.566852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:52.567950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:52.569050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:11:52.569050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:11:52.569050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:11:52.569050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:11:52.569050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:11:52.569050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:11:52.569050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:52.569050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:52.575540 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 274/535] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:52.576932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c250381-af73-4a62-b171-4648f4cf5d9c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:52.616053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ff368-9965-45a2-bd3c-0b4e90c88770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:52.617527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ff368-9965-45a2-bd3c-0b4e90c88770 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:52.618082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ff368-9965-45a2-bd3c-0b4e90c88770 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:52.619505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ff368-9965-45a2-bd3c-0b4e90c88770 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:52.620404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ff368-9965-45a2-bd3c-0b4e90c88770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:52.621554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ff368-9965-45a2-bd3c-0b4e90c88770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:52.623094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ff368-9965-45a2-bd3c-0b4e90c88770 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:52.649582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 262/536] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:52.652886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ff368-9965-45a2-bd3c-0b4e90c88770 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:52.748156 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c250381-af73-4a62-b171-4648f4cf5d9c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:52.803129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:52.830872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ff368-9965-45a2-bd3c-0b4e90c88770 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:52.846801 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3370a3a-6b73-4375-b32e-70a05c2645f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:52.848182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3370a3a-6b73-4375-b32e-70a05c2645f3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:52.848473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3370a3a-6b73-4375-b32e-70a05c2645f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:52.848758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3370a3a-6b73-4375-b32e-70a05c2645f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:52.849560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3370a3a-6b73-4375-b32e-70a05c2645f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:52.849877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3370a3a-6b73-4375-b32e-70a05c2645f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:52.851450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3370a3a-6b73-4375-b32e-70a05c2645f3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:52.876596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 275/537] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:52.883991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3370a3a-6b73-4375-b32e-70a05c2645f3 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:52.885353 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edda82e-ff62-47d6-8126-4fffea0d1a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:52.887309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edda82e-ff62-47d6-8126-4fffea0d1a52 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:52.887825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edda82e-ff62-47d6-8126-4fffea0d1a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:52.888331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edda82e-ff62-47d6-8126-4fffea0d1a52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:52.904331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:52.906561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edda82e-ff62-47d6-8126-4fffea0d1a52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:52.910058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edda82e-ff62-47d6-8126-4fffea0d1a52 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-0edda82e-ff62-47d6-8126-4fffea0d1a52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:11:52.938287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:52.939179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:52.940052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:11:52.940052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:11:52.940052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:11:52.940052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:11:52.940052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:11:52.940052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:11:52.940052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:52.940052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:52.943057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 263/538] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:11:52.948141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edda82e-ff62-47d6-8126-4fffea0d1a52 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:53.007492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3370a3a-6b73-4375-b32e-70a05c2645f3 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:53.077319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4eb17-3208-4975-be5c-3f0b4c7b897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:53.077992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4eb17-3208-4975-be5c-3f0b4c7b897b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:53.078279 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4eb17-3208-4975-be5c-3f0b4c7b897b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:53.078558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4eb17-3208-4975-be5c-3f0b4c7b897b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:53.079434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4eb17-3208-4975-be5c-3f0b4c7b897b None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=9c142f4d77b54982abcd4b76edbcb4c4) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:53.079759 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4eb17-3208-4975-be5c-3f0b4c7b897b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:53.081297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4eb17-3208-4975-be5c-3f0b4c7b897b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:53.096015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 276/539] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:52 2022] GET /identity/v3/role_assignments?user.id=9c142f4d77b54982abcd4b76edbcb4c4&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:53.096015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9180f98-98d4-4298-94cc-75fae924dbae None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:53.096015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9180f98-98d4-4298-94cc-75fae924dbae None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:53.096015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9180f98-98d4-4298-94cc-75fae924dbae None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:53.096986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 277/540] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:53.104425 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f9fc8-1774-4082-9ce5-4783ec2f1b9c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:53.104715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f9fc8-1774-4082-9ce5-4783ec2f1b9c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:53.104995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f9fc8-1774-4082-9ce5-4783ec2f1b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:53.120980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edda82e-ff62-47d6-8126-4fffea0d1a52 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:53.136229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d14f9fc8-1774-4082-9ce5-4783ec2f1b9c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:53.142525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d14f9fc8-1774-4082-9ce5-4783ec2f1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:53.187043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:53.194990 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e6062-a16c-463e-8b07-47a13e9b7eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:53.196855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e6062-a16c-463e-8b07-47a13e9b7eba None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:53.198030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e6062-a16c-463e-8b07-47a13e9b7eba None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:53.198482 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e6062-a16c-463e-8b07-47a13e9b7eba None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:53.199647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e6062-a16c-463e-8b07-47a13e9b7eba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:53.201405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e6062-a16c-463e-8b07-47a13e9b7eba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:53.203087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e6062-a16c-463e-8b07-47a13e9b7eba None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:53.220487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 264/541] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:53.233067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e6062-a16c-463e-8b07-47a13e9b7eba None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:53.264161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 278/542] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:53.289180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f9fc8-1774-4082-9ce5-4783ec2f1b9c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:53.308352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:53.397038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f9fc8-1774-4082-9ce5-4783ec2f1b9c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:53.402005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e6062-a16c-463e-8b07-47a13e9b7eba None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:53.435317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c24f97-dfa4-4131-bdda-3b3daa3f96d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:53.436499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c24f97-dfa4-4131-bdda-3b3daa3f96d4 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:53.437019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c24f97-dfa4-4131-bdda-3b3daa3f96d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:53.437428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c24f97-dfa4-4131-bdda-3b3daa3f96d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:53.448454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c24f97-dfa4-4131-bdda-3b3daa3f96d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-14c24f97-dfa4-4131-bdda-3b3daa3f96d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:53.457730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:53.458776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:53.459750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:53.461976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 279/543] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:11:53.468147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c24f97-dfa4-4131-bdda-3b3daa3f96d4 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:53.492728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0080f13-5881-4034-aaa7-845e8260a3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:53.493554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0080f13-5881-4034-aaa7-845e8260a3fb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:53.493943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0080f13-5881-4034-aaa7-845e8260a3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:53.494328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0080f13-5881-4034-aaa7-845e8260a3fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:53.495265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0080f13-5881-4034-aaa7-845e8260a3fb None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=b0e658f3947f41a9a3e09ea327b5d8bc) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:53.495689 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0080f13-5881-4034-aaa7-845e8260a3fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:53.497307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0080f13-5881-4034-aaa7-845e8260a3fb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:53.514359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 265/544] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:53 2022] GET /identity/v3/role_assignments?user.id=b0e658f3947f41a9a3e09ea327b5d8bc&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:53.536388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:53.579695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c24f97-dfa4-4131-bdda-3b3daa3f96d4 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:53.618507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b9d5-3ac6-4dad-bb83-63e2c5cbc58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:53.619590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b9d5-3ac6-4dad-bb83-63e2c5cbc58b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:53.620056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b9d5-3ac6-4dad-bb83-63e2c5cbc58b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:53.620562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b9d5-3ac6-4dad-bb83-63e2c5cbc58b None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:53.621519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7b9d5-3ac6-4dad-bb83-63e2c5cbc58b None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:53.622012 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7b9d5-3ac6-4dad-bb83-63e2c5cbc58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:53.623679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7b9d5-3ac6-4dad-bb83-63e2c5cbc58b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:53.634829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 280/545] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:11:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:53.645677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0080f13-5881-4034-aaa7-845e8260a3fb None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:53.678887 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09dbc4-5709-4314-b8a7-41d3a187b6f3 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:53.679077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09dbc4-5709-4314-b8a7-41d3a187b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:53.679370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09dbc4-5709-4314-b8a7-41d3a187b6f3 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:53.680943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 281/546] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:53.692597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3b9f-c5b5-455a-a3ee-e8273cfadf9c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:53.692916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3b9f-c5b5-455a-a3ee-e8273cfadf9c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:53.693166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f3b9f-c5b5-455a-a3ee-e8273cfadf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:53.725128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-256f3b9f-c5b5-455a-a3ee-e8273cfadf9c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:53.726363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-256f3b9f-c5b5-455a-a3ee-e8273cfadf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:53.733733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:53.801118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0080f13-5881-4034-aaa7-845e8260a3fb None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:53.854195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 282/547] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:53.868306 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930c3a0-46cc-417e-97f6-67fe0d965806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:53.869168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930c3a0-46cc-417e-97f6-67fe0d965806 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:53.869464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930c3a0-46cc-417e-97f6-67fe0d965806 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:53.869745 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930c3a0-46cc-417e-97f6-67fe0d965806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:53.884334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930c3a0-46cc-417e-97f6-67fe0d965806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:53.885866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930c3a0-46cc-417e-97f6-67fe0d965806 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:53.901616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f3b9f-c5b5-455a-a3ee-e8273cfadf9c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-9930c3a0-46cc-417e-97f6-67fe0d965806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:53.906255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:53.907122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:53.907948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:53.907948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:53.907948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:53.907948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:53.907948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 266/548] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:53.917676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930c3a0-46cc-417e-97f6-67fe0d965806 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:53.994566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:54.072966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f3b9f-c5b5-455a-a3ee-e8273cfadf9c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:54.118859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930c3a0-46cc-417e-97f6-67fe0d965806 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:54.134146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:54.139994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac412e8-e52b-4535-83f6-275102b660d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:54.140841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac412e8-e52b-4535-83f6-275102b660d7 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:54.141126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac412e8-e52b-4535-83f6-275102b660d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:54.141403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac412e8-e52b-4535-83f6-275102b660d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:54.160217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac412e8-e52b-4535-83f6-275102b660d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-bac412e8-e52b-4535-83f6-275102b660d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:54.168093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:54.168944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:54.170231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:54.174608 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 283/549] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:11:54.175989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac412e8-e52b-4535-83f6-275102b660d7 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:54.208113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bebf69-900e-455d-8e43-6f2bef8a9da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:54.208777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bebf69-900e-455d-8e43-6f2bef8a9da1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:54.210235 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bebf69-900e-455d-8e43-6f2bef8a9da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:54.210525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bebf69-900e-455d-8e43-6f2bef8a9da1 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:54.211258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bebf69-900e-455d-8e43-6f2bef8a9da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:54.211571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bebf69-900e-455d-8e43-6f2bef8a9da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:54.212972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bebf69-900e-455d-8e43-6f2bef8a9da1 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:54.240435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 267/550] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:54.243942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bebf69-900e-455d-8e43-6f2bef8a9da1 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:54.353120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac412e8-e52b-4535-83f6-275102b660d7 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:54.381626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:54.405850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ed929-d7e6-4502-8874-d1d89f41bb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:54.406528 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ed929-d7e6-4502-8874-d1d89f41bb58 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:54.406814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ed929-d7e6-4502-8874-d1d89f41bb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:54.407095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ed929-d7e6-4502-8874-d1d89f41bb58 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:54.407852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ed929-d7e6-4502-8874-d1d89f41bb58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:54.408194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ed929-d7e6-4502-8874-d1d89f41bb58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:54.410381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ed929-d7e6-4502-8874-d1d89f41bb58 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:54.428187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 284/551] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:11:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:11:54.441625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bebf69-900e-455d-8e43-6f2bef8a9da1 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:54.447026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ed929-d7e6-4502-8874-d1d89f41bb58 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:54.517608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ade3e-920e-40cc-a334-8841c59cf0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:54.518416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ade3e-920e-40cc-a334-8841c59cf0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:54.518703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ade3e-920e-40cc-a334-8841c59cf0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:54.519024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ade3e-920e-40cc-a334-8841c59cf0d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:54.530947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ade3e-920e-40cc-a334-8841c59cf0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:54.532423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ade3e-920e-40cc-a334-8841c59cf0d4 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-8f3ade3e-920e-40cc-a334-8841c59cf0d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:11:54.556706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:54.557747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:54.558738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:54.558738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:54.558738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:11:54.558738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:11:54.558738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:11:54.558738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:11:54.558738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:11:54.558738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:11:54.558738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:11:54.558738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:54.558738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 268/552] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 16 00:11:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:54.563447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ade3e-920e-40cc-a334-8841c59cf0d4 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:54.612171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:54.631451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ed929-d7e6-4502-8874-d1d89f41bb58 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:54.693870 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd827fcb-edce-4bce-a0d5-f59f1946b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:54.694939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd827fcb-edce-4bce-a0d5-f59f1946b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:54.695227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd827fcb-edce-4bce-a0d5-f59f1946b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:54.695769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd827fcb-edce-4bce-a0d5-f59f1946b4c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:54.719504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd827fcb-edce-4bce-a0d5-f59f1946b4c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:54.721009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd827fcb-edce-4bce-a0d5-f59f1946b4c9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:54.732721 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ade3e-920e-40cc-a334-8841c59cf0d4 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-bd827fcb-edce-4bce-a0d5-f59f1946b4c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:54.755598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:54.756550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:54.757491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:54.757491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:54.757491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:54.757491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:54.757491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 285/553] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:11:54.763927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd827fcb-edce-4bce-a0d5-f59f1946b4c9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:54.798273 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:54.808662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ebe15-75ee-46a6-911d-186ddbfaa414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:54.809354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ebe15-75ee-46a6-911d-186ddbfaa414 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:54.809640 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ebe15-75ee-46a6-911d-186ddbfaa414 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:54.809913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ebe15-75ee-46a6-911d-186ddbfaa414 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:54.810754 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ebe15-75ee-46a6-911d-186ddbfaa414 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:54.811065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ebe15-75ee-46a6-911d-186ddbfaa414 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:54.812549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ebe15-75ee-46a6-911d-186ddbfaa414 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:54.843684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 269/554] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 16 00:11:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:54.850306 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ebe15-75ee-46a6-911d-186ddbfaa414 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:54.922824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd827fcb-edce-4bce-a0d5-f59f1946b4c9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:54.963832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:54.982425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ebe15-75ee-46a6-911d-186ddbfaa414 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:55.008665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a078d-9af1-4ea0-baf3-7724e144c673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:55.009352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a078d-9af1-4ea0-baf3-7724e144c673 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.009642 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a078d-9af1-4ea0-baf3-7724e144c673 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.009927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a078d-9af1-4ea0-baf3-7724e144c673 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.010663 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a078d-9af1-4ea0-baf3-7724e144c673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:55.010976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a078d-9af1-4ea0-baf3-7724e144c673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:55.012382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a078d-9af1-4ea0-baf3-7724e144c673 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:55.018294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac204296-cfd0-45eb-8ed1-c0c8cb67f436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:55.019762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac204296-cfd0-45eb-8ed1-c0c8cb67f436 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.020085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac204296-cfd0-45eb-8ed1-c0c8cb67f436 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.020371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac204296-cfd0-45eb-8ed1-c0c8cb67f436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.044587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac204296-cfd0-45eb-8ed1-c0c8cb67f436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:55.046142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac204296-cfd0-45eb-8ed1-c0c8cb67f436 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:55.046851 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 286/555] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:55.050290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a078d-9af1-4ea0-baf3-7724e144c673 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-ac204296-cfd0-45eb-8ed1-c0c8cb67f436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:55.084328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:55.085342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:55.086636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:55.086636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:55.086636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:55.086636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:55.086852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 270/556] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:11:55.094580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac204296-cfd0-45eb-8ed1-c0c8cb67f436 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:55.180682 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:55.193843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a078d-9af1-4ea0-baf3-7724e144c673 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:55.214326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac204296-cfd0-45eb-8ed1-c0c8cb67f436 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:55.231131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba429f-2dfb-4c2d-9ab7-d85eec0c58ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:55.232004 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba429f-2dfb-4c2d-9ab7-d85eec0c58ee None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.232303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba429f-2dfb-4c2d-9ab7-d85eec0c58ee None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.232631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba429f-2dfb-4c2d-9ab7-d85eec0c58ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.240787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba429f-2dfb-4c2d-9ab7-d85eec0c58ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:55.242231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba429f-2dfb-4c2d-9ab7-d85eec0c58ee None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:55.254336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4774e-139f-47a9-a223-e1d933febdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:55.255300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4774e-139f-47a9-a223-e1d933febdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.255805 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4774e-139f-47a9-a223-e1d933febdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.256308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4774e-139f-47a9-a223-e1d933febdd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.257228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4774e-139f-47a9-a223-e1d933febdd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-7eba429f-2dfb-4c2d-9ab7-d85eec0c58ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:11:55.257412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:55.258295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:55.259294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:55.259294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:55.259294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:11:55.259294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:11:55.259294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:11:55.259294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:11:55.259294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:11:55.259294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:11:55.259294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:11:55.259294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:55.261241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4774e-139f-47a9-a223-e1d933febdd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:55.262826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4774e-139f-47a9-a223-e1d933febdd5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:55.263365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 287/557] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:11:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:55.264690 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe39bd5-bbb1-4d63-a1ae-d1af072efbbf None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.264987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe39bd5-bbb1-4d63-a1ae-d1af072efbbf None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.265267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe39bd5-bbb1-4d63-a1ae-d1af072efbbf None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.270926 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 288/558] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:55.270926 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe39bd5-bbb1-4d63-a1ae-d1af072efbbf None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:55.273577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:55.283253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 271/559] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:55.285390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc058c22-c0c7-4ab8-be57-a1be0a0a5c0a None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.285891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc058c22-c0c7-4ab8-be57-a1be0a0a5c0a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.286391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc058c22-c0c7-4ab8-be57-a1be0a0a5c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.309466 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-bc058c22-c0c7-4ab8-be57-a1be0a0a5c0a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:55.310966 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bc058c22-c0c7-4ab8-be57-a1be0a0a5c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:55.383988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 272/560] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:55.385300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc058c22-c0c7-4ab8-be57-a1be0a0a5c0a None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:55.403691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe39bd5-bbb1-4d63-a1ae-d1af072efbbf None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:55.444860 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79210f1b-cd90-406a-8202-8cd3668dd039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:55.445464 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79210f1b-cd90-406a-8202-8cd3668dd039 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.445753 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79210f1b-cd90-406a-8202-8cd3668dd039 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.446035 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79210f1b-cd90-406a-8202-8cd3668dd039 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.446888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79210f1b-cd90-406a-8202-8cd3668dd039 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:55.447196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79210f1b-cd90-406a-8202-8cd3668dd039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:55.448774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79210f1b-cd90-406a-8202-8cd3668dd039 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:55.467361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 289/561] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 16 00:11:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:55.473179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79210f1b-cd90-406a-8202-8cd3668dd039 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:55.481806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:55.511139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc058c22-c0c7-4ab8-be57-a1be0a0a5c0a None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:55.542920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:55.552960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eaa17a-68db-4e4e-9a64-ef9c74ed4ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:55.554151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa17a-68db-4e4e-9a64-ef9c74ed4ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.554674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa17a-68db-4e4e-9a64-ef9c74ed4ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.555152 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eaa17a-68db-4e4e-9a64-ef9c74ed4ea3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.562528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eaa17a-68db-4e4e-9a64-ef9c74ed4ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:55.564459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eaa17a-68db-4e4e-9a64-ef9c74ed4ea3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-72eaa17a-68db-4e4e-9a64-ef9c74ed4ea3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:11:55.579294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:55.580395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:55.586513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:11:55.586513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:11:55.586513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:11:55.586513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:11:55.586513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:11:55.586513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:11:55.586513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:55.586513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:55.586513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 273/562] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:55.586513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eaa17a-68db-4e4e-9a64-ef9c74ed4ea3 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:55.590036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79210f1b-cd90-406a-8202-8cd3668dd039 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:55.626746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5262f-805f-474f-8460-b1374308736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:55.627875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5262f-805f-474f-8460-b1374308736e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.628201 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5262f-805f-474f-8460-b1374308736e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.628594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5262f-805f-474f-8460-b1374308736e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.639227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5262f-805f-474f-8460-b1374308736e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-3af5262f-805f-474f-8460-b1374308736e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:55.647617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:55.648595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:55.649438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 290/563] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:55.651139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b861-4cc9-4479-abc3-8379905fee2a None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.651139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b861-4cc9-4479-abc3-8379905fee2a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.651139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b861-4cc9-4479-abc3-8379905fee2a None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.656059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 291/564] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:55.656059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b861-4cc9-4479-abc3-8379905fee2a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:55.695469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eaa17a-68db-4e4e-9a64-ef9c74ed4ea3 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:55.728041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:55.730547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116000bf-3717-4e31-8113-9df3edf9aeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:55.731406 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116000bf-3717-4e31-8113-9df3edf9aeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.731700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116000bf-3717-4e31-8113-9df3edf9aeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.732007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116000bf-3717-4e31-8113-9df3edf9aeb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.771594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b861-4cc9-4479-abc3-8379905fee2a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:55.795572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:55.809106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116000bf-3717-4e31-8113-9df3edf9aeb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:55.811306 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116000bf-3717-4e31-8113-9df3edf9aeb8 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:55.812348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77e989-e4b9-4a46-b553-27b315519f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:55.813044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e989-e4b9-4a46-b553-27b315519f3b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.813329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e989-e4b9-4a46-b553-27b315519f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.813605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77e989-e4b9-4a46-b553-27b315519f3b None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.814398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77e989-e4b9-4a46-b553-27b315519f3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:55.814716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77e989-e4b9-4a46-b553-27b315519f3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:55.816828 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77e989-e4b9-4a46-b553-27b315519f3b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:55.829009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 292/565] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:55.829644 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77e989-e4b9-4a46-b553-27b315519f3b None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:55.915446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 274/566] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:11:55.916929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618615d-e3ae-4629-8aea-eecf0e2cf715 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.917224 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618615d-e3ae-4629-8aea-eecf0e2cf715 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.917505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618615d-e3ae-4629-8aea-eecf0e2cf715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.928680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77e989-e4b9-4a46-b553-27b315519f3b None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:55.933685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-0618615d-e3ae-4629-8aea-eecf0e2cf715 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:55.934867 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-0618615d-e3ae-4629-8aea-eecf0e2cf715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:55.953123 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:55.962241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6822090-4353-4c28-8629-9ada6f40c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:55.962909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822090-4353-4c28-8629-9ada6f40c6ce None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.963202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822090-4353-4c28-8629-9ada6f40c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.963486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822090-4353-4c28-8629-9ada6f40c6ce None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.964271 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822090-4353-4c28-8629-9ada6f40c6ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:55.964587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822090-4353-4c28-8629-9ada6f40c6ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:55.966211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822090-4353-4c28-8629-9ada6f40c6ce None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:55.975072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 293/567] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:11:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:55.976699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e44340-92c6-4c20-903a-87b54d2247e5 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:55.976999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e44340-92c6-4c20-903a-87b54d2247e5 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:55.977615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e44340-92c6-4c20-903a-87b54d2247e5 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:55.979024 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 294/568] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:55.983461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e44340-92c6-4c20-903a-87b54d2247e5 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.000186 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 275/569] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:56.001130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618615d-e3ae-4629-8aea-eecf0e2cf715 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.024565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:56.099767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e44340-92c6-4c20-903a-87b54d2247e5 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:56.104434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618615d-e3ae-4629-8aea-eecf0e2cf715 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:56.132729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e261988-29f6-4fda-a9b0-fe1cbc0bb620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:56.133617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e261988-29f6-4fda-a9b0-fe1cbc0bb620 None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:56.133907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e261988-29f6-4fda-a9b0-fe1cbc0bb620 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:56.134183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e261988-29f6-4fda-a9b0-fe1cbc0bb620 None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/cd57046b084b463488296b825097081d/roles/b8116338d60f4b38ba6e70a4726765f2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:56.137214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b4e5d-9b66-41cb-95df-a13832fd458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:56.138011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b4e5d-9b66-41cb-95df-a13832fd458d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:56.138281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b4e5d-9b66-41cb-95df-a13832fd458d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:56.138554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b4e5d-9b66-41cb-95df-a13832fd458d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:56.148020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e261988-29f6-4fda-a9b0-fe1cbc0bb620 None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=cd57046b084b463488296b825097081d, role_id=b8116338d60f4b38ba6e70a4726765f2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:56.148233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b4e5d-9b66-41cb-95df-a13832fd458d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:56.149461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e261988-29f6-4fda-a9b0-fe1cbc0bb620 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:56.149665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b4e5d-9b66-41cb-95df-a13832fd458d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:56.162167 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 295/570] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:11:55 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/cd57046b084b463488296b825097081d/roles/b8116338d60f4b38ba6e70a4726765f2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:56.162942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e261988-29f6-4fda-a9b0-fe1cbc0bb620 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-1b1b4e5d-9b66-41cb-95df-a13832fd458d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:56.167477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:56.168600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:56.169552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:56.169552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:56.169552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:56.169552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:56.169552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 276/571] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:56.170159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8df1-a4c6-40e4-b15d-13185c1f0789 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:56.170339 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8df1-a4c6-40e4-b15d-13185c1f0789 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:56.170583 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8df1-a4c6-40e4-b15d-13185c1f0789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:56.188533 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-9edb8df1-a4c6-40e4-b15d-13185c1f0789 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:56.189760 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9edb8df1-a4c6-40e4-b15d-13185c1f0789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:56.227179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:56.260628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:56.266430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 277/572] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:56.267305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb8df1-a4c6-40e4-b15d-13185c1f0789 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.310420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e261988-29f6-4fda-a9b0-fe1cbc0bb620 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:56.354320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466a626-5256-4b71-bd45-c4cffd37a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:56.355435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466a626-5256-4b71-bd45-c4cffd37a547 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:56.355895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466a626-5256-4b71-bd45-c4cffd37a547 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:56.356341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466a626-5256-4b71-bd45-c4cffd37a547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:56.367909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466a626-5256-4b71-bd45-c4cffd37a547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:56.370051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466a626-5256-4b71-bd45-c4cffd37a547 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:56.378045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb8df1-a4c6-40e4-b15d-13185c1f0789 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-5466a626-5256-4b71-bd45-c4cffd37a547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:56.390280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:56.391147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:56.392184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:56.392184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:56.392184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:56.392184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:56.392184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 296/573] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:56.392453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466a626-5256-4b71-bd45-c4cffd37a547 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.418040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179cfd1-74b5-48bb-a101-cf831ba4fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:56.418844 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179cfd1-74b5-48bb-a101-cf831ba4fe07 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:56.419132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179cfd1-74b5-48bb-a101-cf831ba4fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:56.419418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179cfd1-74b5-48bb-a101-cf831ba4fe07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:56.429922 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179cfd1-74b5-48bb-a101-cf831ba4fe07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-d179cfd1-74b5-48bb-a101-cf831ba4fe07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:56.437784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:56.438698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:56.439527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 278/574] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:56.440250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179cfd1-74b5-48bb-a101-cf831ba4fe07 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.499585 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:56.503415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:56.512457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466a626-5256-4b71-bd45-c4cffd37a547 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:56.548495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4587c5-0989-459e-a1fc-e23f46f05e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:56.549304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4587c5-0989-459e-a1fc-e23f46f05e40 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:56.549588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4587c5-0989-459e-a1fc-e23f46f05e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:56.549865 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4587c5-0989-459e-a1fc-e23f46f05e40 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:56.550613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4587c5-0989-459e-a1fc-e23f46f05e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:56.550922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4587c5-0989-459e-a1fc-e23f46f05e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:56.552328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4587c5-0989-459e-a1fc-e23f46f05e40 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:56.554795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179cfd1-74b5-48bb-a101-cf831ba4fe07 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:56.564004 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 297/575] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:56.565106 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4587c5-0989-459e-a1fc-e23f46f05e40 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.593648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412547f0-6c9b-41fe-a16a-55d901606d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:56.594458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412547f0-6c9b-41fe-a16a-55d901606d0e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:56.594741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412547f0-6c9b-41fe-a16a-55d901606d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:56.595015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412547f0-6c9b-41fe-a16a-55d901606d0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:56.608540 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412547f0-6c9b-41fe-a16a-55d901606d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-412547f0-6c9b-41fe-a16a-55d901606d0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:56.617192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:56.618203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:56.619054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 279/576] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:56.619740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412547f0-6c9b-41fe-a16a-55d901606d0e None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.680879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4587c5-0989-459e-a1fc-e23f46f05e40 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:56.717173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf69f7d-5242-41ed-956a-60293d782e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:56.717850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf69f7d-5242-41ed-956a-60293d782e30 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:56.718122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf69f7d-5242-41ed-956a-60293d782e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:56.718402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf69f7d-5242-41ed-956a-60293d782e30 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:56.719126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf69f7d-5242-41ed-956a-60293d782e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:56.719438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf69f7d-5242-41ed-956a-60293d782e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:56.720860 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf69f7d-5242-41ed-956a-60293d782e30 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:56.723333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412547f0-6c9b-41fe-a16a-55d901606d0e None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:56.732740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 298/577] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:56.733733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf69f7d-5242-41ed-956a-60293d782e30 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.747382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:56.748488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:56.763580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec11e9-5dec-4962-b28f-6a9ea3dcd6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:56.764217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec11e9-5dec-4962-b28f-6a9ea3dcd6be None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:56.764502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec11e9-5dec-4962-b28f-6a9ea3dcd6be None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:56.764781 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec11e9-5dec-4962-b28f-6a9ea3dcd6be None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:56.765522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec11e9-5dec-4962-b28f-6a9ea3dcd6be None admin] RBAC: Adding query filter params (name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:56.765830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec11e9-5dec-4962-b28f-6a9ea3dcd6be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:56.767268 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec11e9-5dec-4962-b28f-6a9ea3dcd6be None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:56.776340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 280/578] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:56.777131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec11e9-5dec-4962-b28f-6a9ea3dcd6be None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.842515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf69f7d-5242-41ed-956a-60293d782e30 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:56.876979 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2cf73-96c4-4eb4-9e0e-c5086b3418d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:56.877803 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2cf73-96c4-4eb4-9e0e-c5086b3418d1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:56.878105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2cf73-96c4-4eb4-9e0e-c5086b3418d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:56.878883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2cf73-96c4-4eb4-9e0e-c5086b3418d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:56.885536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2cf73-96c4-4eb4-9e0e-c5086b3418d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:56.886959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec11e9-5dec-4962-b28f-6a9ea3dcd6be None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:56.887074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2cf73-96c4-4eb4-9e0e-c5086b3418d1 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-f0c2cf73-96c4-4eb4-9e0e-c5086b3418d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:11:56.901118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:56.902007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:56.902880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:11:56.902880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:11:56.902880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:11:56.902880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:11:56.902880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:11:56.902880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:11:56.902880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:56.902880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:56.902880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 299/579] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:56.903361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2cf73-96c4-4eb4-9e0e-c5086b3418d1 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.928282 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85232154-0a48-4c8b-904d-aff487d9fbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:56.928957 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85232154-0a48-4c8b-904d-aff487d9fbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:56.929238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85232154-0a48-4c8b-904d-aff487d9fbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:56.929513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85232154-0a48-4c8b-904d-aff487d9fbf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:56.930258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85232154-0a48-4c8b-904d-aff487d9fbf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:56.930568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85232154-0a48-4c8b-904d-aff487d9fbf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:56.932201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85232154-0a48-4c8b-904d-aff487d9fbf5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:56.945711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 281/580] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:56.945711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85232154-0a48-4c8b-904d-aff487d9fbf5 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:56.980702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:56.991836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:57.014094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2cf73-96c4-4eb4-9e0e-c5086b3418d1 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:57.054097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4ca1d-7918-4e8e-a4c9-38a76d087255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:57.054692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85232154-0a48-4c8b-904d-aff487d9fbf5 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:57.054895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ca1d-7918-4e8e-a4c9-38a76d087255 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:57.055181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ca1d-7918-4e8e-a4c9-38a76d087255 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:57.055458 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ca1d-7918-4e8e-a4c9-38a76d087255 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:57.064425 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4ca1d-7918-4e8e-a4c9-38a76d087255 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:57.066291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4ca1d-7918-4e8e-a4c9-38a76d087255 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-1cc4ca1d-7918-4e8e-a4c9-38a76d087255 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:11:57.080701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:57.082131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:57.083132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:57.083132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:57.083132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:11:57.083132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:11:57.083132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:11:57.083132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:11:57.083132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:11:57.083132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:11:57.083132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:11:57.083132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:57.085066 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 300/581] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:57.085964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4ca1d-7918-4e8e-a4c9-38a76d087255 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:57.097174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e048d-7cd3-43a3-b18d-a115e59c78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:57.097971 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e048d-7cd3-43a3-b18d-a115e59c78fc None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:57.098251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e048d-7cd3-43a3-b18d-a115e59c78fc None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:57.098524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e048d-7cd3-43a3-b18d-a115e59c78fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:57.109774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e048d-7cd3-43a3-b18d-a115e59c78fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:57.111456 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e048d-7cd3-43a3-b18d-a115e59c78fc None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-840e048d-7cd3-43a3-b18d-a115e59c78fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:57.129487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:57.130450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:57.131366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:57.131366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:57.131366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:57.131366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:57.131366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 282/582] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:57.131366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e048d-7cd3-43a3-b18d-a115e59c78fc None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:57.196905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4ca1d-7918-4e8e-a4c9-38a76d087255 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:57.227293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:57.230784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:57.236057 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5475e8c-42ae-488c-90cd-a09a76246703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:57.236740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475e8c-42ae-488c-90cd-a09a76246703 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:57.237025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475e8c-42ae-488c-90cd-a09a76246703 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:57.237308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475e8c-42ae-488c-90cd-a09a76246703 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:57.238650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5475e8c-42ae-488c-90cd-a09a76246703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:57.238820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e048d-7cd3-43a3-b18d-a115e59c78fc None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:57.238989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5475e8c-42ae-488c-90cd-a09a76246703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:57.240473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5475e8c-42ae-488c-90cd-a09a76246703 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:57.254127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 301/583] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:57.254961 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5475e8c-42ae-488c-90cd-a09a76246703 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:57.282061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf42478-9491-42fe-9535-1aa7cd6c19ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:57.282979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf42478-9491-42fe-9535-1aa7cd6c19ae None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:57.283274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf42478-9491-42fe-9535-1aa7cd6c19ae None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:57.283602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf42478-9491-42fe-9535-1aa7cd6c19ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:57.296362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf42478-9491-42fe-9535-1aa7cd6c19ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:57.297940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf42478-9491-42fe-9535-1aa7cd6c19ae None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-ddf42478-9491-42fe-9535-1aa7cd6c19ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:57.317266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:57.318165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:57.319075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:57.319075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:57.319075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:57.319075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:57.319075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 283/584] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:57.319788 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf42478-9491-42fe-9535-1aa7cd6c19ae None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:57.360271 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5475e8c-42ae-488c-90cd-a09a76246703 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:57.395309 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd1238-ecab-4059-bd71-8fe06355a290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:57.396012 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1238-ecab-4059-bd71-8fe06355a290 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:57.396304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1238-ecab-4059-bd71-8fe06355a290 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:57.396575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1238-ecab-4059-bd71-8fe06355a290 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:57.397403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd1238-ecab-4059-bd71-8fe06355a290 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:57.397715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd1238-ecab-4059-bd71-8fe06355a290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:57.399140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd1238-ecab-4059-bd71-8fe06355a290 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:57.420100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 302/585] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 16 00:11:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:57.420100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd1238-ecab-4059-bd71-8fe06355a290 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:57.433560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf42478-9491-42fe-9535-1aa7cd6c19ae None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:57.467063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a76a5-d7ba-4dea-9464-0b046320e3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:57.467720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a76a5-d7ba-4dea-9464-0b046320e3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:57.468032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a76a5-d7ba-4dea-9464-0b046320e3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:57.468313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a76a5-d7ba-4dea-9464-0b046320e3b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:57.469028 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a76a5-d7ba-4dea-9464-0b046320e3b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:57.469333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a76a5-d7ba-4dea-9464-0b046320e3b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:57.470703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a76a5-d7ba-4dea-9464-0b046320e3b3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:57.472933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:57.483701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 284/586] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:57.484526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a76a5-d7ba-4dea-9464-0b046320e3b3 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:57.495645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:57.533771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd1238-ecab-4059-bd71-8fe06355a290 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:57.576320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b82920-16d2-44c2-bc40-1720b135708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:57.577240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82920-16d2-44c2-bc40-1720b135708f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:57.577527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82920-16d2-44c2-bc40-1720b135708f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:57.578054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b82920-16d2-44c2-bc40-1720b135708f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:57.579281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b82920-16d2-44c2-bc40-1720b135708f None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=88d67d41124c4deda1c5ecdab82d3055) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:57.579929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b82920-16d2-44c2-bc40-1720b135708f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:57.582069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b82920-16d2-44c2-bc40-1720b135708f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:57.587445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a76a5-d7ba-4dea-9464-0b046320e3b3 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:57.596388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 303/587] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:11:57 2022] GET /identity/v3/role_assignments?user.id=88d67d41124c4deda1c5ecdab82d3055&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:57.596388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b82920-16d2-44c2-bc40-1720b135708f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:57.627474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eab6f7-77a1-48d3-b6b3-ad011ee51936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:57.628177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab6f7-77a1-48d3-b6b3-ad011ee51936 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:57.629001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab6f7-77a1-48d3-b6b3-ad011ee51936 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:57.629278 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab6f7-77a1-48d3-b6b3-ad011ee51936 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:57.630014 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eab6f7-77a1-48d3-b6b3-ad011ee51936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:57.630355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eab6f7-77a1-48d3-b6b3-ad011ee51936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:57.631774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eab6f7-77a1-48d3-b6b3-ad011ee51936 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:57.645514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 285/588] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:57.646405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eab6f7-77a1-48d3-b6b3-ad011ee51936 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:57.731506 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b82920-16d2-44c2-bc40-1720b135708f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:57.736620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:57.748858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:57.774679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133be2b-c2b3-4019-9bdc-dfacfce63aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:57.775543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133be2b-c2b3-4019-9bdc-dfacfce63aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:57.775830 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133be2b-c2b3-4019-9bdc-dfacfce63aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:57.776203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133be2b-c2b3-4019-9bdc-dfacfce63aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:57.789523 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eab6f7-77a1-48d3-b6b3-ad011ee51936 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:57.791270 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133be2b-c2b3-4019-9bdc-dfacfce63aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:57.792793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133be2b-c2b3-4019-9bdc-dfacfce63aa2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-b133be2b-c2b3-4019-9bdc-dfacfce63aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:57.814417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:57.815530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:57.816498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:57.816498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:57.816498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:57.816498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:57.817008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 304/589] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:57.817758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133be2b-c2b3-4019-9bdc-dfacfce63aa2 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:57.828254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991333f-d937-43af-9fe2-104a74332ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:57.829400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991333f-d937-43af-9fe2-104a74332ebb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:57.829996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991333f-d937-43af-9fe2-104a74332ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:57.830475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991333f-d937-43af-9fe2-104a74332ebb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:57.839835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991333f-d937-43af-9fe2-104a74332ebb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:57.842720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991333f-d937-43af-9fe2-104a74332ebb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-1991333f-d937-43af-9fe2-104a74332ebb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:11:57.859681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:57.860975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:57.861905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:57.861905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:57.861905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:11:57.861905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:11:57.861905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:11:57.861905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:11:57.861905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:11:57.861905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:11:57.861905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:11:57.861905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:57.864484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 286/590] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:57.865475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991333f-d937-43af-9fe2-104a74332ebb None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:57.947031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133be2b-c2b3-4019-9bdc-dfacfce63aa2 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:57.994100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32fae7-5e92-4789-a3db-37477c086031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:57.995174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32fae7-5e92-4789-a3db-37477c086031 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:57.995460 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32fae7-5e92-4789-a3db-37477c086031 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:57.995739 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32fae7-5e92-4789-a3db-37477c086031 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.000730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991333f-d937-43af-9fe2-104a74332ebb None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:58.005933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32fae7-5e92-4789-a3db-37477c086031 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:58.007375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32fae7-5e92-4789-a3db-37477c086031 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-0a32fae7-5e92-4789-a3db-37477c086031 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:11:58.032222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:58.033170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:58.034092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:58.034092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:58.034092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:11:58.034092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:11:58.034092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:11:58.034092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:11:58.034092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:11:58.034092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:11:58.034092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:11:58.034092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:58.037031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 305/591] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:11:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:58.038077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32fae7-5e92-4789-a3db-37477c086031 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:58.038186 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:58.050564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27299dff-102b-46eb-831e-89c5791fd45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:58.051217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27299dff-102b-46eb-831e-89c5791fd45d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.051507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27299dff-102b-46eb-831e-89c5791fd45d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.051783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27299dff-102b-46eb-831e-89c5791fd45d None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.052549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27299dff-102b-46eb-831e-89c5791fd45d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:58.052861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27299dff-102b-46eb-831e-89c5791fd45d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:58.054408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27299dff-102b-46eb-831e-89c5791fd45d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:58.067994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 287/592] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:58.068843 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27299dff-102b-46eb-831e-89c5791fd45d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:58.074576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:58.177256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32fae7-5e92-4789-a3db-37477c086031 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:58.187404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27299dff-102b-46eb-831e-89c5791fd45d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:58.214764 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb428dfc-6734-4a8d-8fb0-941e2be598f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:58.215740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb428dfc-6734-4a8d-8fb0-941e2be598f9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.216470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb428dfc-6734-4a8d-8fb0-941e2be598f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.216919 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb428dfc-6734-4a8d-8fb0-941e2be598f9 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.217938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb428dfc-6734-4a8d-8fb0-941e2be598f9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:58.218453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb428dfc-6734-4a8d-8fb0-941e2be598f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:58.220140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb428dfc-6734-4a8d-8fb0-941e2be598f9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:58.236896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce8dc3-4689-423c-9736-1c8823c0c439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:58.238934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8dc3-4689-423c-9736-1c8823c0c439 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.239232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8dc3-4689-423c-9736-1c8823c0c439 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.239517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8dc3-4689-423c-9736-1c8823c0c439 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.240807 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8dc3-4689-423c-9736-1c8823c0c439 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:58.241192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8dc3-4689-423c-9736-1c8823c0c439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:58.242714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8dc3-4689-423c-9736-1c8823c0c439 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:58.243322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 306/593] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Jun 16 00:11:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:58.248995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb428dfc-6734-4a8d-8fb0-941e2be598f9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:58.271205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 288/594] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 16 00:11:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:58.271205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce8dc3-4689-423c-9736-1c8823c0c439 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:58.324024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:58.345613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:58.365976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb428dfc-6734-4a8d-8fb0-941e2be598f9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:58.382103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce8dc3-4689-423c-9736-1c8823c0c439 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:58.400996 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982811f-8f84-40ca-a193-3964b97f9502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:58.401799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982811f-8f84-40ca-a193-3964b97f9502 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.402084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982811f-8f84-40ca-a193-3964b97f9502 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.402362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982811f-8f84-40ca-a193-3964b97f9502 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.410107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982811f-8f84-40ca-a193-3964b97f9502 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:58.411546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982811f-8f84-40ca-a193-3964b97f9502 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:58.418326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b10419-32cc-4954-8c06-a7dff691dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:58.419125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b10419-32cc-4954-8c06-a7dff691dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.419409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b10419-32cc-4954-8c06-a7dff691dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.419686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b10419-32cc-4954-8c06-a7dff691dcb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-2982811f-8f84-40ca-a193-3964b97f9502 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:11:58.425323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:58.426258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:58.427149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:11:58.427149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:11:58.427149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:11:58.427149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:11:58.427149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:11:58.427149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:11:58.427149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:58.427149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:58.427149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 307/595] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:58.427626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982811f-8f84-40ca-a193-3964b97f9502 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:58.434606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b10419-32cc-4954-8c06-a7dff691dcb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:58.436114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b10419-32cc-4954-8c06-a7dff691dcb9 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-97b10419-32cc-4954-8c06-a7dff691dcb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:58.454500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:58.455436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:58.456473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:58.456473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:58.456473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:58.456473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:58.456473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 289/596] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:58.457337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aea45-f897-44aa-b9ac-64239337a862 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.457622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aea45-f897-44aa-b9ac-64239337a862 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.457897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aea45-f897-44aa-b9ac-64239337a862 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.459274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 290/597] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:58.463674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aea45-f897-44aa-b9ac-64239337a862 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:58.538182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982811f-8f84-40ca-a193-3964b97f9502 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:58.570581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:58.574419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23551ae-c66f-4c69-a400-0750e7edc437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:58.575155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23551ae-c66f-4c69-a400-0750e7edc437 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.575430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23551ae-c66f-4c69-a400-0750e7edc437 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.575782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23551ae-c66f-4c69-a400-0750e7edc437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.576262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aea45-f897-44aa-b9ac-64239337a862 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:58.587368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23551ae-c66f-4c69-a400-0750e7edc437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:58.588828 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23551ae-c66f-4c69-a400-0750e7edc437 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:58.590656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-d23551ae-c66f-4c69-a400-0750e7edc437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:58.606677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:58.607636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:58.608533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:58.608533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:58.608533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:58.608533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:58.608533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 308/598] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:58.608808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23551ae-c66f-4c69-a400-0750e7edc437 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:58.620462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e32504-eba4-4b2e-a5c9-096da6fc24f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:58.621506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32504-eba4-4b2e-a5c9-096da6fc24f3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.621970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32504-eba4-4b2e-a5c9-096da6fc24f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.622463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32504-eba4-4b2e-a5c9-096da6fc24f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.623524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e32504-eba4-4b2e-a5c9-096da6fc24f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:58.624043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e32504-eba4-4b2e-a5c9-096da6fc24f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:58.625863 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e32504-eba4-4b2e-a5c9-096da6fc24f3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:58.638215 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 291/599] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:58.639388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc9e8d-515c-49f5-b6fd-57f12625135e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.639677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc9e8d-515c-49f5-b6fd-57f12625135e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.639958 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc9e8d-515c-49f5-b6fd-57f12625135e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.656885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f5bc9e8d-515c-49f5-b6fd-57f12625135e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:58.658183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f5bc9e8d-515c-49f5-b6fd-57f12625135e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:58.719557 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23551ae-c66f-4c69-a400-0750e7edc437 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:58.740144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 292/600] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:11:58.741474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc9e8d-515c-49f5-b6fd-57f12625135e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:58.759340 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef68c30-d64e-40a1-ba97-eac38188754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:58.760035 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef68c30-d64e-40a1-ba97-eac38188754e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.760324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef68c30-d64e-40a1-ba97-eac38188754e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.760602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef68c30-d64e-40a1-ba97-eac38188754e None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.761329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef68c30-d64e-40a1-ba97-eac38188754e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:58.761636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef68c30-d64e-40a1-ba97-eac38188754e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:58.762992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef68c30-d64e-40a1-ba97-eac38188754e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:58.775746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 309/601] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:58.776666 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef68c30-d64e-40a1-ba97-eac38188754e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:58.835800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:58.851455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:58.864451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc9e8d-515c-49f5-b6fd-57f12625135e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:58.882526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef68c30-d64e-40a1-ba97-eac38188754e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:58.900397 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d1d0e-4fd3-449f-b7c5-d41d7e097e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:58.901063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d1d0e-4fd3-449f-b7c5-d41d7e097e27 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.901338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d1d0e-4fd3-449f-b7c5-d41d7e097e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.901614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d1d0e-4fd3-449f-b7c5-d41d7e097e27 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.902331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d1d0e-4fd3-449f-b7c5-d41d7e097e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:58.902644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d1d0e-4fd3-449f-b7c5-d41d7e097e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:58.904335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d1d0e-4fd3-449f-b7c5-d41d7e097e27 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:58.915772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 293/602] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:58.916415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d1d0e-4fd3-449f-b7c5-d41d7e097e27 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:58.922512 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32d61c-4724-4ab8-aef6-eefef8f983c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:58.923478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32d61c-4724-4ab8-aef6-eefef8f983c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:58.923764 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32d61c-4724-4ab8-aef6-eefef8f983c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:58.924070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32d61c-4724-4ab8-aef6-eefef8f983c4 None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/7ee61aece9c64e74806248e4ac49cd47/roles/b8116338d60f4b38ba6e70a4726765f2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:58.940055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32d61c-4724-4ab8-aef6-eefef8f983c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=7ee61aece9c64e74806248e4ac49cd47, role_id=b8116338d60f4b38ba6e70a4726765f2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:58.942015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32d61c-4724-4ab8-aef6-eefef8f983c4 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:58.955768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 310/603] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:11:58 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/7ee61aece9c64e74806248e4ac49cd47/roles/b8116338d60f4b38ba6e70a4726765f2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:58.957439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32d61c-4724-4ab8-aef6-eefef8f983c4 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:59.048648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d1d0e-4fd3-449f-b7c5-d41d7e097e27 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:59.089455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391ff4c-1183-4e97-9bda-021d3387a8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:59.090612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391ff4c-1183-4e97-9bda-021d3387a8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.091344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391ff4c-1183-4e97-9bda-021d3387a8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.091806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391ff4c-1183-4e97-9bda-021d3387a8d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.096132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32d61c-4724-4ab8-aef6-eefef8f983c4 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:59.098885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:59.105828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391ff4c-1183-4e97-9bda-021d3387a8d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-9391ff4c-1183-4e97-9bda-021d3387a8d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:11:59.115089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:59.116144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:11:59.118495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:59.119789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 294/604] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:11:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:59.120936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391ff4c-1183-4e97-9bda-021d3387a8d7 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:59.135659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:59.143371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8625b-32ef-4297-befd-369e8f3ee924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:59.144325 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8625b-32ef-4297-befd-369e8f3ee924 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.144610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8625b-32ef-4297-befd-369e8f3ee924 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.144943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8625b-32ef-4297-befd-369e8f3ee924 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.154300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8625b-32ef-4297-befd-369e8f3ee924 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:59.155889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8625b-32ef-4297-befd-369e8f3ee924 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-9df8625b-32ef-4297-befd-369e8f3ee924 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:11:59.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:59.172274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:59.173137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:11:59.173137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:11:59.173137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:11:59.173137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:11:59.173137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:11:59.173137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:11:59.173137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:59.173137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:11:59.173137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 311/605] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:59.173646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8625b-32ef-4297-befd-369e8f3ee924 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:59.235531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391ff4c-1183-4e97-9bda-021d3387a8d7 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:59.269990 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49037a89-21cf-44d4-830f-587d6fee89c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:59.270794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49037a89-21cf-44d4-830f-587d6fee89c4 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.271088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49037a89-21cf-44d4-830f-587d6fee89c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.271376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49037a89-21cf-44d4-830f-587d6fee89c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.278360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49037a89-21cf-44d4-830f-587d6fee89c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:59.279883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49037a89-21cf-44d4-830f-587d6fee89c4 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:59.280180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8625b-32ef-4297-befd-369e8f3ee924 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-49037a89-21cf-44d4-830f-587d6fee89c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:11:59.294562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:59.295508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:59.296403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:11:59.296403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:11:59.296403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:11:59.296403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:11:59.296403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:11:59.296403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:11:59.296403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:11:59.296403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:59.296403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 295/606] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:59.296908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49037a89-21cf-44d4-830f-587d6fee89c4 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:59.322221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89e2cb-06ad-4fca-bd2c-908e653497cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:59.322896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e2cb-06ad-4fca-bd2c-908e653497cf None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.323284 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e2cb-06ad-4fca-bd2c-908e653497cf None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.323568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e2cb-06ad-4fca-bd2c-908e653497cf None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.324346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89e2cb-06ad-4fca-bd2c-908e653497cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:59.324656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89e2cb-06ad-4fca-bd2c-908e653497cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:59.326115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89e2cb-06ad-4fca-bd2c-908e653497cf None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:59.336115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 312/607] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:11:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:59.337032 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89e2cb-06ad-4fca-bd2c-908e653497cf None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:59.376579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:59.377923 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:59.408593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49037a89-21cf-44d4-830f-587d6fee89c4 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:59.445344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cff5a-898c-4c59-b172-eb0867216210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:59.446397 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cff5a-898c-4c59-b172-eb0867216210 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.446831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cff5a-898c-4c59-b172-eb0867216210 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.447257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cff5a-898c-4c59-b172-eb0867216210 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.448345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cff5a-898c-4c59-b172-eb0867216210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:59.448826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cff5a-898c-4c59-b172-eb0867216210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:59.450459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cff5a-898c-4c59-b172-eb0867216210 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:59.455052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89e2cb-06ad-4fca-bd2c-908e653497cf None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:59.464209 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 296/608] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:59.465407 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cff5a-898c-4c59-b172-eb0867216210 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:59.492472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616334eb-6a84-4119-8c83-68b9e0784ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:59.493141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616334eb-6a84-4119-8c83-68b9e0784ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.493428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616334eb-6a84-4119-8c83-68b9e0784ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.493929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616334eb-6a84-4119-8c83-68b9e0784ee2 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.494584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616334eb-6a84-4119-8c83-68b9e0784ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:59.494957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616334eb-6a84-4119-8c83-68b9e0784ee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:59.496468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616334eb-6a84-4119-8c83-68b9e0784ee2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:59.513932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 313/609] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:59.513932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616334eb-6a84-4119-8c83-68b9e0784ee2 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:59.581707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cff5a-898c-4c59-b172-eb0867216210 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:59.603045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:59.611841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:59.620717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616334eb-6a84-4119-8c83-68b9e0784ee2 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:59.622547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cac677-0e28-448f-96a1-9d06d4d22d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:59.623996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cac677-0e28-448f-96a1-9d06d4d22d30 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.623996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cac677-0e28-448f-96a1-9d06d4d22d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.624426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cac677-0e28-448f-96a1-9d06d4d22d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.636617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cac677-0e28-448f-96a1-9d06d4d22d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:59.637872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cac677-0e28-448f-96a1-9d06d4d22d30 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-70cac677-0e28-448f-96a1-9d06d4d22d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:11:59.656857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:11:59.657786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:11:59.658672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:11:59.658672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:11:59.658672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:11:59.658672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:11:59.658672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 297/610] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:11:59.660345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cac677-0e28-448f-96a1-9d06d4d22d30 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:59.660646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0649825-a1f7-428a-b19b-c3be4556b37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:59.661845 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0649825-a1f7-428a-b19b-c3be4556b37a None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.662321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0649825-a1f7-428a-b19b-c3be4556b37a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.662792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0649825-a1f7-428a-b19b-c3be4556b37a None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/9c142f4d77b54982abcd4b76edbcb4c4/roles/b8116338d60f4b38ba6e70a4726765f2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.679612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0649825-a1f7-428a-b19b-c3be4556b37a None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=9c142f4d77b54982abcd4b76edbcb4c4, role_id=b8116338d60f4b38ba6e70a4726765f2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:59.681639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0649825-a1f7-428a-b19b-c3be4556b37a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:59.700619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 314/611] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:11:59 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/9c142f4d77b54982abcd4b76edbcb4c4/roles/b8116338d60f4b38ba6e70a4726765f2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:59.701469 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0649825-a1f7-428a-b19b-c3be4556b37a None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:11:59.777485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cac677-0e28-448f-96a1-9d06d4d22d30 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:59.819225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34876930-cada-4087-ba35-140ed5453d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:59.820614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876930-cada-4087-ba35-140ed5453d36 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.821103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876930-cada-4087-ba35-140ed5453d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.821584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34876930-cada-4087-ba35-140ed5453d36 None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/b0e658f3947f41a9a3e09ea327b5d8bc/roles/b8116338d60f4b38ba6e70a4726765f2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.838746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876930-cada-4087-ba35-140ed5453d36 None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=b0e658f3947f41a9a3e09ea327b5d8bc, role_id=b8116338d60f4b38ba6e70a4726765f2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:59.840586 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34876930-cada-4087-ba35-140ed5453d36 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:59.866089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 298/612] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:11:59 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/b0e658f3947f41a9a3e09ea327b5d8bc/roles/b8116338d60f4b38ba6e70a4726765f2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:11:59.867550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de4fd-48c7-43ce-8f67-9657bc98f22c None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.867849 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de4fd-48c7-43ce-8f67-9657bc98f22c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.868161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de4fd-48c7-43ce-8f67-9657bc98f22c None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.869636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 299/613] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:11:59.877445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d1316-8722-4e16-a333-ff238c402e3e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.877823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d1316-8722-4e16-a333-ff238c402e3e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.878156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d1316-8722-4e16-a333-ff238c402e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.900216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0649825-a1f7-428a-b19b-c3be4556b37a None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:11:59.900398 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e58d1316-8722-4e16-a333-ff238c402e3e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:11:59.901439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e58d1316-8722-4e16-a333-ff238c402e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:11:59.939941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b807e8-f547-4e6f-8409-f3b69816d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:11:59.940917 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:59.941256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b807e8-f547-4e6f-8409-f3b69816d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:11:59.941746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b807e8-f547-4e6f-8409-f3b69816d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:11:59.942254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b807e8-f547-4e6f-8409-f3b69816d7d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:11:59.943299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b807e8-f547-4e6f-8409-f3b69816d7d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:11:59.943821 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b807e8-f547-4e6f-8409-f3b69816d7d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:11:59.945520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b807e8-f547-4e6f-8409-f3b69816d7d1 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:11:59.960364 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:11:59.965390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 315/614] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:11:59.970892 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b807e8-f547-4e6f-8409-f3b69816d7d1 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:00.030995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 300/615] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:12:00.064904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d1316-8722-4e16-a333-ff238c402e3e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:00.116223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b807e8-f547-4e6f-8409-f3b69816d7d1 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:00.155084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb33b8-7fea-47b3-9600-bc18941783ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:00.156081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb33b8-7fea-47b3-9600-bc18941783ae None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:00.156268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb33b8-7fea-47b3-9600-bc18941783ae None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:00.156536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb33b8-7fea-47b3-9600-bc18941783ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:00.164935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb33b8-7fea-47b3-9600-bc18941783ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:00.166526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb33b8-7fea-47b3-9600-bc18941783ae None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-49eb33b8-7fea-47b3-9600-bc18941783ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:00.182810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:00.183802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:00.184767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:00.184767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:00.184767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:00.184767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:00.184767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:00.184767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:00.184767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:00.184767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:00.184767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:00.184767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:00.184767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 316/616] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 16 00:11:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:00.189412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb33b8-7fea-47b3-9600-bc18941783ae None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:00.197996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d1316-8722-4e16-a333-ff238c402e3e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:00.235813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01004b81-1c33-4622-98db-68c45de9c7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:00.236767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004b81-1c33-4622-98db-68c45de9c7ac None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:00.237119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004b81-1c33-4622-98db-68c45de9c7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:00.237963 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01004b81-1c33-4622-98db-68c45de9c7ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:00.248974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01004b81-1c33-4622-98db-68c45de9c7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-01004b81-1c33-4622-98db-68c45de9c7ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:00.257119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:00.258093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:00.258953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 301/617] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:12:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:00.264149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01004b81-1c33-4622-98db-68c45de9c7ac None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:00.266985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:00.293600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:00.330227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb33b8-7fea-47b3-9600-bc18941783ae None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:00.374579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403393b-7e94-4a8b-8b6e-9b6180df9c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:00.376103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403393b-7e94-4a8b-8b6e-9b6180df9c31 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:00.376606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403393b-7e94-4a8b-8b6e-9b6180df9c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:00.377065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403393b-7e94-4a8b-8b6e-9b6180df9c31 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:00.378949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403393b-7e94-4a8b-8b6e-9b6180df9c31 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:00.379638 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403393b-7e94-4a8b-8b6e-9b6180df9c31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:00.382002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403393b-7e94-4a8b-8b6e-9b6180df9c31 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:00.389989 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01004b81-1c33-4622-98db-68c45de9c7ac None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:00.406802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 317/618] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 16 00:12:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:00.412917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403393b-7e94-4a8b-8b6e-9b6180df9c31 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:00.443591 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b421eb-d260-4b73-a9f1-db65ef9b640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:00.444608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b421eb-d260-4b73-a9f1-db65ef9b640d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:00.445104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b421eb-d260-4b73-a9f1-db65ef9b640d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:00.445564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b421eb-d260-4b73-a9f1-db65ef9b640d None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:00.446548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b421eb-d260-4b73-a9f1-db65ef9b640d None admin] RBAC: Adding query filter params (name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:00.447080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b421eb-d260-4b73-a9f1-db65ef9b640d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:00.448821 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b421eb-d260-4b73-a9f1-db65ef9b640d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:00.458413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 302/619] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:12:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:00.464264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b421eb-d260-4b73-a9f1-db65ef9b640d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:00.515452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403393b-7e94-4a8b-8b6e-9b6180df9c31 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:00.530685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:00.559151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535af23-de50-484b-982c-264b610785d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:00.560215 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535af23-de50-484b-982c-264b610785d8 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:00.560744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535af23-de50-484b-982c-264b610785d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:00.561225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535af23-de50-484b-982c-264b610785d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:00.584141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:00.616313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b421eb-d260-4b73-a9f1-db65ef9b640d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:00.677676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535af23-de50-484b-982c-264b610785d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:00.677676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535af23-de50-484b-982c-264b610785d8 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:00.686992 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f613d5-b544-426e-977d-a819ae2b187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:00.688198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f613d5-b544-426e-977d-a819ae2b187d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:00.688718 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f613d5-b544-426e-977d-a819ae2b187d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:00.689195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f613d5-b544-426e-977d-a819ae2b187d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:00.703502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f613d5-b544-426e-977d-a819ae2b187d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:00.705340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f613d5-b544-426e-977d-a819ae2b187d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-54f613d5-b544-426e-977d-a819ae2b187d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:00.738600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:00.739580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:00.740496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:00.740496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:00.740496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:00.740496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:00.744537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 303/620] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:00.751145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f613d5-b544-426e-977d-a819ae2b187d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:00.853825 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 318/621] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:00.860484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535af23-de50-484b-982c-264b610785d8 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:00.878011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:00.952457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f613d5-b544-426e-977d-a819ae2b187d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:00.979354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535af23-de50-484b-982c-264b610785d8 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:01.012593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b261-e4cd-4b33-8193-6d69cf34326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:01.013260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b261-e4cd-4b33-8193-6d69cf34326c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:01.013553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b261-e4cd-4b33-8193-6d69cf34326c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:01.013838 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b261-e4cd-4b33-8193-6d69cf34326c None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:01.017119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1b261-e4cd-4b33-8193-6d69cf34326c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:01.017119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1b261-e4cd-4b33-8193-6d69cf34326c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:01.017119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1b261-e4cd-4b33-8193-6d69cf34326c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:01.036866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:01.041666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 304/622] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:01.048894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b261-e4cd-4b33-8193-6d69cf34326c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:01.049329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85ff30-b4d1-4a8c-8b63-3a62fd126c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:01.050658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85ff30-b4d1-4a8c-8b63-3a62fd126c8a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:01.050943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85ff30-b4d1-4a8c-8b63-3a62fd126c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:01.051209 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85ff30-b4d1-4a8c-8b63-3a62fd126c8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:01.061736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85ff30-b4d1-4a8c-8b63-3a62fd126c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:01.063197 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85ff30-b4d1-4a8c-8b63-3a62fd126c8a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-8a85ff30-b4d1-4a8c-8b63-3a62fd126c8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:01.097304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:01.098265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:01.099146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:01.099146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:01.099146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:01.099146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:01.101850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 319/623] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:01.105326 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85ff30-b4d1-4a8c-8b63-3a62fd126c8a None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:01.218439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:01.234166 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b261-e4cd-4b33-8193-6d69cf34326c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:01.280582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502fece-828e-4870-934f-0e7dd30e5435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:01.282376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502fece-828e-4870-934f-0e7dd30e5435 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:01.282887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502fece-828e-4870-934f-0e7dd30e5435 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:01.283396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502fece-828e-4870-934f-0e7dd30e5435 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:01.292191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502fece-828e-4870-934f-0e7dd30e5435 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:01.293949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502fece-828e-4870-934f-0e7dd30e5435 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:01.301213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85ff30-b4d1-4a8c-8b63-3a62fd126c8a None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-3502fece-828e-4870-934f-0e7dd30e5435 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:01.313025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:01.314058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:01.315036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:01.315036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:01.315036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:01.315036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:01.315036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:01.315036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:01.315036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:01.315036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:01.315036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:12:01.315036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:01.323998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 305/624] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:01.323998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502fece-828e-4870-934f-0e7dd30e5435 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:01.390431 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf226-eeb2-4dc7-8841-3d38ebd20ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:01.391120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf226-eeb2-4dc7-8841-3d38ebd20ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:01.391433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf226-eeb2-4dc7-8841-3d38ebd20ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:01.391689 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcf226-eeb2-4dc7-8841-3d38ebd20ff1 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:01.392463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcf226-eeb2-4dc7-8841-3d38ebd20ff1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:01.392780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcf226-eeb2-4dc7-8841-3d38ebd20ff1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:01.394277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcf226-eeb2-4dc7-8841-3d38ebd20ff1 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:01.400341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:01.420245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 320/625] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:01.424868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf226-eeb2-4dc7-8841-3d38ebd20ff1 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:01.483722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502fece-828e-4870-934f-0e7dd30e5435 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:01.526365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620175e-c380-4b3f-90ed-9b036e4f8c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:01.527484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620175e-c380-4b3f-90ed-9b036e4f8c30 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:01.528083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620175e-c380-4b3f-90ed-9b036e4f8c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:01.528568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620175e-c380-4b3f-90ed-9b036e4f8c30 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:01.529604 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620175e-c380-4b3f-90ed-9b036e4f8c30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:01.530102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620175e-c380-4b3f-90ed-9b036e4f8c30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:01.531904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620175e-c380-4b3f-90ed-9b036e4f8c30 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:01.560311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 306/626] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 16 00:12:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:01.562027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1a7f0-bcf2-40a5-a329-e20240786be3 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:01.562486 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1a7f0-bcf2-40a5-a329-e20240786be3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:01.562923 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1a7f0-bcf2-40a5-a329-e20240786be3 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:01.568899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 307/627] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:01.569733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1a7f0-bcf2-40a5-a329-e20240786be3 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:01.603173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcf226-eeb2-4dc7-8841-3d38ebd20ff1 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:01.631635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:01.641821 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe9bb3-d208-44e0-b7d0-399899f911b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:01.642945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9bb3-d208-44e0-b7d0-399899f911b3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:01.643492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9bb3-d208-44e0-b7d0-399899f911b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:01.644042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9bb3-d208-44e0-b7d0-399899f911b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:01.651372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe9bb3-d208-44e0-b7d0-399899f911b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:01.653135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe9bb3-d208-44e0-b7d0-399899f911b3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-b2fe9bb3-d208-44e0-b7d0-399899f911b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:01.668022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:01.668945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:01.670002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:01.670002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:01.670002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:01.670002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:01.670002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:01.670002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:01.670002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:01.670002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:01.677322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 321/628] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:01.678804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff85e3-25e0-4a81-b975-f381b5d6f4a1 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:01.679772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff85e3-25e0-4a81-b975-f381b5d6f4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:01.680290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff85e3-25e0-4a81-b975-f381b5d6f4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:01.684454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1a7f0-bcf2-40a5-a329-e20240786be3 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:01.698308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-c8ff85e3-25e0-4a81-b975-f381b5d6f4a1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:01.698645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:01.700427 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c8ff85e3-25e0-4a81-b975-f381b5d6f4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:01.721584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0042b-b226-4510-a5e7-4637104ac3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:01.722412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0042b-b226-4510-a5e7-4637104ac3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:01.722694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0042b-b226-4510-a5e7-4637104ac3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:01.722971 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0042b-b226-4510-a5e7-4637104ac3e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:01.736252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0042b-b226-4510-a5e7-4637104ac3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:01.738147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0042b-b226-4510-a5e7-4637104ac3e2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-b0b0042b-b226-4510-a5e7-4637104ac3e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:01.761193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:01.762122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:01.763023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:01.763023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:01.763023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:01.763023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:01.763023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 308/629] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:01.767610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0042b-b226-4510-a5e7-4637104ac3e2 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:01.783986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 322/630] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:01.785275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff85e3-25e0-4a81-b975-f381b5d6f4a1 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:01.881003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0042b-b226-4510-a5e7-4637104ac3e2 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:01.906809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff85e3-25e0-4a81-b975-f381b5d6f4a1 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:01.916700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693253c-edf3-499f-aa6b-9c7ecdf47e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:01.917365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693253c-edf3-499f-aa6b-9c7ecdf47e20 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:01.917648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693253c-edf3-499f-aa6b-9c7ecdf47e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:01.917926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693253c-edf3-499f-aa6b-9c7ecdf47e20 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:01.918890 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693253c-edf3-499f-aa6b-9c7ecdf47e20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:01.919092 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693253c-edf3-499f-aa6b-9c7ecdf47e20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:01.920540 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693253c-edf3-499f-aa6b-9c7ecdf47e20 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:01.928009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:01.934087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 309/631] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:01.935020 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693253c-edf3-499f-aa6b-9c7ecdf47e20 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:01.949601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321d76d-166f-40e6-8842-22316bfc68da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:01.950629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d76d-166f-40e6-8842-22316bfc68da None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:01.951145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d76d-166f-40e6-8842-22316bfc68da None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:01.951636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321d76d-166f-40e6-8842-22316bfc68da None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:01.952650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321d76d-166f-40e6-8842-22316bfc68da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:01.953179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321d76d-166f-40e6-8842-22316bfc68da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:01.954889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321d76d-166f-40e6-8842-22316bfc68da None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:01.961053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:01.972459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 323/632] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:01.973723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321d76d-166f-40e6-8842-22316bfc68da None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:02.042144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693253c-edf3-499f-aa6b-9c7ecdf47e20 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:02.078502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53189b98-75bc-4649-b2c0-5440f2e98b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:02.079313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53189b98-75bc-4649-b2c0-5440f2e98b46 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.079754 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53189b98-75bc-4649-b2c0-5440f2e98b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.080060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53189b98-75bc-4649-b2c0-5440f2e98b46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.093814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53189b98-75bc-4649-b2c0-5440f2e98b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:02.094837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321d76d-166f-40e6-8842-22316bfc68da None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-53189b98-75bc-4649-b2c0-5440f2e98b46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:02.103761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:02.104750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:02.105592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 310/633] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:12:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:02.106304 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53189b98-75bc-4649-b2c0-5440f2e98b46 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:02.139136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765cc71-5ad7-4483-a5fc-71136f4f47c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:02.140260 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765cc71-5ad7-4483-a5fc-71136f4f47c0 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.140866 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765cc71-5ad7-4483-a5fc-71136f4f47c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.141348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765cc71-5ad7-4483-a5fc-71136f4f47c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.142440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765cc71-5ad7-4483-a5fc-71136f4f47c0 None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=cd57046b084b463488296b825097081d) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:02.142979 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765cc71-5ad7-4483-a5fc-71136f4f47c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:02.144829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765cc71-5ad7-4483-a5fc-71136f4f47c0 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:02.151912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 324/634] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:01 2022] GET /identity/v3/role_assignments?user.id=cd57046b084b463488296b825097081d&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:02.153154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765cc71-5ad7-4483-a5fc-71136f4f47c0 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:02.200598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:02.202421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:02.218063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53189b98-75bc-4649-b2c0-5440f2e98b46 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:02.255312 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980204c-6e7b-4800-806d-9d9ed0a4fe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:02.256255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980204c-6e7b-4800-806d-9d9ed0a4fe3a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.256544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980204c-6e7b-4800-806d-9d9ed0a4fe3a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.256825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980204c-6e7b-4800-806d-9d9ed0a4fe3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.265302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980204c-6e7b-4800-806d-9d9ed0a4fe3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:02.266869 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980204c-6e7b-4800-806d-9d9ed0a4fe3a None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:02.277460 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765cc71-5ad7-4483-a5fc-71136f4f47c0 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-0980204c-6e7b-4800-806d-9d9ed0a4fe3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:02.284038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:02.285085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:02.285972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:02.285972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:02.285972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:02.285972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:02.285972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:02.285972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:02.285972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:02.285972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:02.288833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 311/635] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:02.292104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980204c-6e7b-4800-806d-9d9ed0a4fe3a None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:02.327262 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56143961-b12d-4b39-9d04-0ee136f529a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:02.327977 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143961-b12d-4b39-9d04-0ee136f529a3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.328273 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143961-b12d-4b39-9d04-0ee136f529a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.328551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143961-b12d-4b39-9d04-0ee136f529a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.329324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143961-b12d-4b39-9d04-0ee136f529a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:02.329636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143961-b12d-4b39-9d04-0ee136f529a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:02.331331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143961-b12d-4b39-9d04-0ee136f529a3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:02.341007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 325/636] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:12:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:02.342544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbdeb2-d737-4861-928c-d2045a0f71c3 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.342835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbdeb2-d737-4861-928c-d2045a0f71c3 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.343113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbdeb2-d737-4861-928c-d2045a0f71c3 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.344716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 326/637] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:02.349599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbdeb2-d737-4861-928c-d2045a0f71c3 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:02.404859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980204c-6e7b-4800-806d-9d9ed0a4fe3a None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:02.452018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e5e6b-0574-461b-815c-43904d13befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:02.452687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e5e6b-0574-461b-815c-43904d13befe None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.452973 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e5e6b-0574-461b-815c-43904d13befe None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.453249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e5e6b-0574-461b-815c-43904d13befe None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.454038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e5e6b-0574-461b-815c-43904d13befe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:02.454351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e5e6b-0574-461b-815c-43904d13befe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:02.455785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e5e6b-0574-461b-815c-43904d13befe None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:02.472158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 312/638] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:02.473590 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01537f-fd0f-4063-bc8d-7e47b8284c03 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.473881 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01537f-fd0f-4063-bc8d-7e47b8284c03 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.474162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01537f-fd0f-4063-bc8d-7e47b8284c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.486334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:02.498876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ae01537f-fd0f-4063-bc8d-7e47b8284c03 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:02.501097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ae01537f-fd0f-4063-bc8d-7e47b8284c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:02.504756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbdeb2-d737-4861-928c-d2045a0f71c3 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:02.506699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:02.548149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ef753-f740-47f6-a1a6-d0ad44ea60b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:02.550824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ef753-f740-47f6-a1a6-d0ad44ea60b6 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.550824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ef753-f740-47f6-a1a6-d0ad44ea60b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.551055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ef753-f740-47f6-a1a6-d0ad44ea60b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.564258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ef753-f740-47f6-a1a6-d0ad44ea60b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:02.565820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ef753-f740-47f6-a1a6-d0ad44ea60b6 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-475ef753-f740-47f6-a1a6-d0ad44ea60b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:02.583417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:02.584543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:02.585635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:02.585635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:02.585635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:02.585635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:02.585635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 327/639] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:02.586078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ef753-f740-47f6-a1a6-d0ad44ea60b6 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:02.586152 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 313/640] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:02.587283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c460c-5638-4954-9e5e-f86ad06e77d0 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.587627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c460c-5638-4954-9e5e-f86ad06e77d0 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.587916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c460c-5638-4954-9e5e-f86ad06e77d0 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.589517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 314/641] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:02.594317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c460c-5638-4954-9e5e-f86ad06e77d0 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:02.700197 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ef753-f740-47f6-a1a6-d0ad44ea60b6 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:02.710635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c460c-5638-4954-9e5e-f86ad06e77d0 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:02.735174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc983de-098d-4d89-b9bd-42f0b146e52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:02.736098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc983de-098d-4d89-b9bd-42f0b146e52f None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.736386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc983de-098d-4d89-b9bd-42f0b146e52f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.736666 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc983de-098d-4d89-b9bd-42f0b146e52f None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/88d67d41124c4deda1c5ecdab82d3055/roles/b8116338d60f4b38ba6e70a4726765f2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.747723 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c606d-2149-4690-9fb5-9ed99f7498e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:02.748728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c606d-2149-4690-9fb5-9ed99f7498e2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.749224 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c606d-2149-4690-9fb5-9ed99f7498e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.749656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c606d-2149-4690-9fb5-9ed99f7498e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.750524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c606d-2149-4690-9fb5-9ed99f7498e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:02.750998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c606d-2149-4690-9fb5-9ed99f7498e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:02.751684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc983de-098d-4d89-b9bd-42f0b146e52f None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=88d67d41124c4deda1c5ecdab82d3055, role_id=b8116338d60f4b38ba6e70a4726765f2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:02.752697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c606d-2149-4690-9fb5-9ed99f7498e2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:02.753188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc983de-098d-4d89-b9bd-42f0b146e52f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:02.754535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:02.767069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 315/642] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:02.768219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36124f5-e60b-4515-8ffd-d2b0892d05e3 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.768563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36124f5-e60b-4515-8ffd-d2b0892d05e3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.768881 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36124f5-e60b-4515-8ffd-d2b0892d05e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.769494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 328/643] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:12:02 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/88d67d41124c4deda1c5ecdab82d3055/roles/b8116338d60f4b38ba6e70a4726765f2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:12:02.770820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc983de-098d-4d89-b9bd-42f0b146e52f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:02.774924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:02.797688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e36124f5-e60b-4515-8ffd-d2b0892d05e3 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:02.799580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e36124f5-e60b-4515-8ffd-d2b0892d05e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:02.892001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 316/644] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:02.892001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36124f5-e60b-4515-8ffd-d2b0892d05e3 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:02.927466 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc983de-098d-4d89-b9bd-42f0b146e52f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:02.968476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aae95e-8212-497f-a425-b3cea5d7fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:02.969309 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aae95e-8212-497f-a425-b3cea5d7fa56 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:02.969648 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aae95e-8212-497f-a425-b3cea5d7fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:02.969928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aae95e-8212-497f-a425-b3cea5d7fa56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:02.982101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aae95e-8212-497f-a425-b3cea5d7fa56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-20aae95e-8212-497f-a425-b3cea5d7fa56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:02.991792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:02.993005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:02.993881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 329/645] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:12:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:02.994589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aae95e-8212-497f-a425-b3cea5d7fa56 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:03.031827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36124f5-e60b-4515-8ffd-d2b0892d05e3 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:03.058351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:03.067883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:03.070403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0791cb-935e-4be3-a2d8-60f794979678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:03.071405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0791cb-935e-4be3-a2d8-60f794979678 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:03.071797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0791cb-935e-4be3-a2d8-60f794979678 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:03.072241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0791cb-935e-4be3-a2d8-60f794979678 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:03.080849 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0791cb-935e-4be3-a2d8-60f794979678 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:03.083023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0791cb-935e-4be3-a2d8-60f794979678 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-5d0791cb-935e-4be3-a2d8-60f794979678 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:03.099472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:03.100630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:03.101746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:03.101746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:03.101746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:03.101746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:03.101746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:03.101746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:03.101746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:03.101746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:03.101746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:12:03.101746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:03.101746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 317/646] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:03.102389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0791cb-935e-4be3-a2d8-60f794979678 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:03.119859 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aae95e-8212-497f-a425-b3cea5d7fa56 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:03.155894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d614f-e559-4248-a248-3017906e52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:03.157063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d614f-e559-4248-a248-3017906e52e1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:03.157561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d614f-e559-4248-a248-3017906e52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:03.158063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d614f-e559-4248-a248-3017906e52e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:03.169075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d614f-e559-4248-a248-3017906e52e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-dd2d614f-e559-4248-a248-3017906e52e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:03.177894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:03.178854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:03.179704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:03.182456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 330/647] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:12:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:03.183478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d614f-e559-4248-a248-3017906e52e1 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:03.214851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0791cb-935e-4be3-a2d8-60f794979678 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:03.253695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5516c-5df0-4345-bf8b-99513873b7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:03.254423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5516c-5df0-4345-bf8b-99513873b7fb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:03.254760 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5516c-5df0-4345-bf8b-99513873b7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:03.255168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5516c-5df0-4345-bf8b-99513873b7fb None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:03.255950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5516c-5df0-4345-bf8b-99513873b7fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:03.256506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5516c-5df0-4345-bf8b-99513873b7fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:03.257789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5516c-5df0-4345-bf8b-99513873b7fb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:03.272051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 318/648] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:03.272943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5516c-5df0-4345-bf8b-99513873b7fb None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:03.305074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d614f-e559-4248-a248-3017906e52e1 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:03.324438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:03.333416 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:03.347680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99171f6-75ae-4387-b23c-9ac95587c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:03.348563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99171f6-75ae-4387-b23c-9ac95587c128 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:03.348956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99171f6-75ae-4387-b23c-9ac95587c128 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:03.349611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99171f6-75ae-4387-b23c-9ac95587c128 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:03.350286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99171f6-75ae-4387-b23c-9ac95587c128 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:03.350707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99171f6-75ae-4387-b23c-9ac95587c128 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:03.352287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99171f6-75ae-4387-b23c-9ac95587c128 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:03.374492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 331/649] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 16 00:12:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:03.375531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99171f6-75ae-4387-b23c-9ac95587c128 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:03.391213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5516c-5df0-4345-bf8b-99513873b7fb None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:03.434873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d356d0-57bb-494d-8ce5-1fbbbae60bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:03.436093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d356d0-57bb-494d-8ce5-1fbbbae60bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:03.437197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d356d0-57bb-494d-8ce5-1fbbbae60bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:03.437483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d356d0-57bb-494d-8ce5-1fbbbae60bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:03.438249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d356d0-57bb-494d-8ce5-1fbbbae60bc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:03.438566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d356d0-57bb-494d-8ce5-1fbbbae60bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:03.439982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d356d0-57bb-494d-8ce5-1fbbbae60bc3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:03.455707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 319/650] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:03.456743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d356d0-57bb-494d-8ce5-1fbbbae60bc3 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:03.502160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99171f6-75ae-4387-b23c-9ac95587c128 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:03.540194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d737ba5-f9d5-4c9f-a021-781f2beece44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:03.541368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737ba5-f9d5-4c9f-a021-781f2beece44 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:03.541871 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737ba5-f9d5-4c9f-a021-781f2beece44 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:03.542372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d737ba5-f9d5-4c9f-a021-781f2beece44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:03.553372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d737ba5-f9d5-4c9f-a021-781f2beece44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:03.555149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d737ba5-f9d5-4c9f-a021-781f2beece44 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-8d737ba5-f9d5-4c9f-a021-781f2beece44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:03.574019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:03.575006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:03.575904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:03.575904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:03.575904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:03.575904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:03.576616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d356d0-57bb-494d-8ce5-1fbbbae60bc3 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:03.578378 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 332/651] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:03.579369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d737ba5-f9d5-4c9f-a021-781f2beece44 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:03.593836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:03.630723 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195912-8ba8-48af-bcbf-47e0da5ce197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:03.630971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:03.633496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195912-8ba8-48af-bcbf-47e0da5ce197 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:03.634057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195912-8ba8-48af-bcbf-47e0da5ce197 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:03.634549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195912-8ba8-48af-bcbf-47e0da5ce197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:03.716371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d737ba5-f9d5-4c9f-a021-781f2beece44 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:03.721153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3195912-8ba8-48af-bcbf-47e0da5ce197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:03.722864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3195912-8ba8-48af-bcbf-47e0da5ce197 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:03.764932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38161c6-ec4f-4624-8110-1f82623ddbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:03.765790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38161c6-ec4f-4624-8110-1f82623ddbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:03.766081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38161c6-ec4f-4624-8110-1f82623ddbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:03.766363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38161c6-ec4f-4624-8110-1f82623ddbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:03.780451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38161c6-ec4f-4624-8110-1f82623ddbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:03.782661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38161c6-ec4f-4624-8110-1f82623ddbe6 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-b38161c6-ec4f-4624-8110-1f82623ddbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:03.807274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:03.808240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:03.809144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:03.809144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:03.809144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:03.809144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:03.812109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 333/652] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:03.813164 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38161c6-ec4f-4624-8110-1f82623ddbe6 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:03.858475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 320/653] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:03.858475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195912-8ba8-48af-bcbf-47e0da5ce197 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:03.869532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:03.921222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:03.947991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38161c6-ec4f-4624-8110-1f82623ddbe6 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:03.974093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dbdbc-8f7b-4987-a374-ff64b9207b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:03.974945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dbdbc-8f7b-4987-a374-ff64b9207b3c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:03.975334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dbdbc-8f7b-4987-a374-ff64b9207b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:03.975718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dbdbc-8f7b-4987-a374-ff64b9207b3c None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:03.976605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dbdbc-8f7b-4987-a374-ff64b9207b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:03.977018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dbdbc-8f7b-4987-a374-ff64b9207b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:03.978491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dbdbc-8f7b-4987-a374-ff64b9207b3c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:03.979405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195912-8ba8-48af-bcbf-47e0da5ce197 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:03.991044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 334/654] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:03.992108 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dbdbc-8f7b-4987-a374-ff64b9207b3c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:04.027459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4791f4b-fa9b-4150-8c03-e1b0bbbbc2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:04.028188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4791f4b-fa9b-4150-8c03-e1b0bbbbc2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.028474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4791f4b-fa9b-4150-8c03-e1b0bbbbc2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.028758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4791f4b-fa9b-4150-8c03-e1b0bbbbc2b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.029599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4791f4b-fa9b-4150-8c03-e1b0bbbbc2b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:04.029916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4791f4b-fa9b-4150-8c03-e1b0bbbbc2b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:04.031418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4791f4b-fa9b-4150-8c03-e1b0bbbbc2b2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:04.048674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 321/655] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:04.049570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4791f4b-fa9b-4150-8c03-e1b0bbbbc2b2 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:04.099787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dbdbc-8f7b-4987-a374-ff64b9207b3c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:04.127761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:04.140445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba10ad-e0c7-49bc-b1d3-6b926dac3ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:04.141806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba10ad-e0c7-49bc-b1d3-6b926dac3ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.142328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba10ad-e0c7-49bc-b1d3-6b926dac3ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.142803 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba10ad-e0c7-49bc-b1d3-6b926dac3ab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.156827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba10ad-e0c7-49bc-b1d3-6b926dac3ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:04.158268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba10ad-e0c7-49bc-b1d3-6b926dac3ab8 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:04.160962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4791f4b-fa9b-4150-8c03-e1b0bbbbc2b2 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:04.172285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-37ba10ad-e0c7-49bc-b1d3-6b926dac3ab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:04.189734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:04.191175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:04.192099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:04.192099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:04.192099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:04.192099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:04.198232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 335/656] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:04.198232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba10ad-e0c7-49bc-b1d3-6b926dac3ab8 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:04.207765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba27c9-ae53-4ac0-a510-657f8f3f55c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:04.209390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba27c9-ae53-4ac0-a510-657f8f3f55c5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.209866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba27c9-ae53-4ac0-a510-657f8f3f55c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.210357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba27c9-ae53-4ac0-a510-657f8f3f55c5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.224854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba27c9-ae53-4ac0-a510-657f8f3f55c5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:04.227316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba27c9-ae53-4ac0-a510-657f8f3f55c5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-acba27c9-ae53-4ac0-a510-657f8f3f55c5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:04.247230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:04.248266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:04.249219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:04.249219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:04.249219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:04.249219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:04.249219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:04.249219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:04.249219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:04.249219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:04.249219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:12:04.249219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:04.249758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 322/657] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:12:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:04.250472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba27c9-ae53-4ac0-a510-657f8f3f55c5 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:04.302545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba10ad-e0c7-49bc-b1d3-6b926dac3ab8 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:04.335863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bdefe-eb9e-4526-9b5d-ed91b5d06364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:04.336712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bdefe-eb9e-4526-9b5d-ed91b5d06364 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.336991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bdefe-eb9e-4526-9b5d-ed91b5d06364 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.337267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bdefe-eb9e-4526-9b5d-ed91b5d06364 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.345702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bdefe-eb9e-4526-9b5d-ed91b5d06364 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:04.347727 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bdefe-eb9e-4526-9b5d-ed91b5d06364 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-9c2bdefe-eb9e-4526-9b5d-ed91b5d06364 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:04.362535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:04.363563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:04.364549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:04.364549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:04.364549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:04.364549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:04.364549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:04.364549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:04.364549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:04.364549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:04.364549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:12:04.364549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:04.364549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 336/658] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:04.365168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bdefe-eb9e-4526-9b5d-ed91b5d06364 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:04.369176 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba27c9-ae53-4ac0-a510-657f8f3f55c5 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:04.399167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:04.410000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56273e87-f5cc-4ad2-8913-b10d17f9b95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:04.411096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56273e87-f5cc-4ad2-8913-b10d17f9b95d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.411615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56273e87-f5cc-4ad2-8913-b10d17f9b95d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.412145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56273e87-f5cc-4ad2-8913-b10d17f9b95d None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.413082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56273e87-f5cc-4ad2-8913-b10d17f9b95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:04.413672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56273e87-f5cc-4ad2-8913-b10d17f9b95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:04.415385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56273e87-f5cc-4ad2-8913-b10d17f9b95d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:04.426890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:04.430487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 323/659] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:04.431552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56273e87-f5cc-4ad2-8913-b10d17f9b95d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:04.477827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bdefe-eb9e-4526-9b5d-ed91b5d06364 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:04.514216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a0a0c-2216-4dbc-a237-c1811cd6108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:04.515396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a0a0c-2216-4dbc-a237-c1811cd6108c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.515396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a0a0c-2216-4dbc-a237-c1811cd6108c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.515396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a0a0c-2216-4dbc-a237-c1811cd6108c None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.516277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a0a0c-2216-4dbc-a237-c1811cd6108c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:04.516591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a0a0c-2216-4dbc-a237-c1811cd6108c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:04.518023 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a0a0c-2216-4dbc-a237-c1811cd6108c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:04.537031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 337/660] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Jun 16 00:12:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:04.537710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a0a0c-2216-4dbc-a237-c1811cd6108c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:04.550582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56273e87-f5cc-4ad2-8913-b10d17f9b95d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:04.586711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02452253-1ce4-4871-9bcf-b020a7080ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:04.587378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02452253-1ce4-4871-9bcf-b020a7080ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.587663 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02452253-1ce4-4871-9bcf-b020a7080ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.587936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02452253-1ce4-4871-9bcf-b020a7080ff5 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.588789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02452253-1ce4-4871-9bcf-b020a7080ff5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:04.589097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02452253-1ce4-4871-9bcf-b020a7080ff5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:04.590511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02452253-1ce4-4871-9bcf-b020a7080ff5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:04.608599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 324/661] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 16 00:12:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:04.609889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04598142-a1c6-4c37-8d9b-06a44b4fc2b3 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.610178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04598142-a1c6-4c37-8d9b-06a44b4fc2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.610454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04598142-a1c6-4c37-8d9b-06a44b4fc2b3 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.611671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 325/662] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:04.612921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04598142-a1c6-4c37-8d9b-06a44b4fc2b3 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:04.647372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a0a0c-2216-4dbc-a237-c1811cd6108c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:04.664198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:04.666045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:04.685528 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a119fe2-ea88-4994-a4a1-b2b90839ac8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:04.686318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a119fe2-ea88-4994-a4a1-b2b90839ac8b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.686609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a119fe2-ea88-4994-a4a1-b2b90839ac8b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.686899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a119fe2-ea88-4994-a4a1-b2b90839ac8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.693695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a119fe2-ea88-4994-a4a1-b2b90839ac8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:04.695142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a119fe2-ea88-4994-a4a1-b2b90839ac8b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-1a119fe2-ea88-4994-a4a1-b2b90839ac8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:04.709300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:04.710281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:04.711195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:04.711195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:04.711195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:04.711195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:04.711195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:04.711195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:04.711195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:04.711195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:04.711195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 338/663] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:04.711680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a119fe2-ea88-4994-a4a1-b2b90839ac8b None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:04.725606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04598142-a1c6-4c37-8d9b-06a44b4fc2b3 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:04.761908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef24b6-82d4-451a-806d-93118bc4bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:04.762556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef24b6-82d4-451a-806d-93118bc4bab1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.762872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef24b6-82d4-451a-806d-93118bc4bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.763136 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef24b6-82d4-451a-806d-93118bc4bab1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.817197 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a119fe2-ea88-4994-a4a1-b2b90839ac8b None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:04.834159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef24b6-82d4-451a-806d-93118bc4bab1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:04.835633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef24b6-82d4-451a-806d-93118bc4bab1 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:04.853285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fd2ca-49b8-473d-a86a-501668ab6456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:04.853996 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd2ca-49b8-473d-a86a-501668ab6456 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.854288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd2ca-49b8-473d-a86a-501668ab6456 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.854574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fd2ca-49b8-473d-a86a-501668ab6456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.882711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:04.906011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:04.932338 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fd2ca-49b8-473d-a86a-501668ab6456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:04.933735 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fd2ca-49b8-473d-a86a-501668ab6456 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:04.942707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 326/664] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:04.945136 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c659-a589-4c3e-920b-a7cd02eb73e3 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:04.946181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c659-a589-4c3e-920b-a7cd02eb73e3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:04.946696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23c659-a589-4c3e-920b-a7cd02eb73e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:04.970054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-fa23c659-a589-4c3e-920b-a7cd02eb73e3 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:04.972688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fa23c659-a589-4c3e-920b-a7cd02eb73e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:05.039185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 339/665] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:05.040039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fd2ca-49b8-473d-a86a-501668ab6456 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:05.050833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 327/666] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:05.051669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23c659-a589-4c3e-920b-a7cd02eb73e3 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:05.113488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:05.136010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fd2ca-49b8-473d-a86a-501668ab6456 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:05.139439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:05.161973 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23c659-a589-4c3e-920b-a7cd02eb73e3 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:05.168856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4deaaf-5cc7-4980-8a5f-7f254e136362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:05.169509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4deaaf-5cc7-4980-8a5f-7f254e136362 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.169793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4deaaf-5cc7-4980-8a5f-7f254e136362 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.170070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4deaaf-5cc7-4980-8a5f-7f254e136362 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.170847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4deaaf-5cc7-4980-8a5f-7f254e136362 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:05.171158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4deaaf-5cc7-4980-8a5f-7f254e136362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:05.172613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4deaaf-5cc7-4980-8a5f-7f254e136362 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:05.184298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 340/667] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:05.185509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeea63c-06cd-461d-a468-8cc4891b9631 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.185798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeea63c-06cd-461d-a468-8cc4891b9631 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.186078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeea63c-06cd-461d-a468-8cc4891b9631 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.187555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 341/668] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:05.188177 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeea63c-06cd-461d-a468-8cc4891b9631 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:05.199378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e039285-2ebb-49f7-ad09-6e605d5a573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:05.200198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e039285-2ebb-49f7-ad09-6e605d5a573b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.200480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e039285-2ebb-49f7-ad09-6e605d5a573b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.200754 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e039285-2ebb-49f7-ad09-6e605d5a573b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.210699 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e039285-2ebb-49f7-ad09-6e605d5a573b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:05.212283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e039285-2ebb-49f7-ad09-6e605d5a573b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-7e039285-2ebb-49f7-ad09-6e605d5a573b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:05.231773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:05.232879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:05.233986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:05.233986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:05.233986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:05.233986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:05.233986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 328/669] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:05.233986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e039285-2ebb-49f7-ad09-6e605d5a573b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:05.290754 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeea63c-06cd-461d-a468-8cc4891b9631 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:05.322675 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebe394-2df6-4eee-adda-ff55b70ba5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:05.323453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebe394-2df6-4eee-adda-ff55b70ba5af None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.323739 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebe394-2df6-4eee-adda-ff55b70ba5af None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.324041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebe394-2df6-4eee-adda-ff55b70ba5af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.326649 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:05.331530 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e039285-2ebb-49f7-ad09-6e605d5a573b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:05.335891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebe394-2df6-4eee-adda-ff55b70ba5af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:05.337346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebe394-2df6-4eee-adda-ff55b70ba5af None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-40ebe394-2df6-4eee-adda-ff55b70ba5af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:05.354732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:05.355667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:05.356575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:05.356575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:05.356575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:05.356575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:05.356575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 342/670] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:05.357144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebe394-2df6-4eee-adda-ff55b70ba5af None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:05.363918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:05.373244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b88ac-427e-4976-9760-b795f1c67bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:05.374032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b88ac-427e-4976-9760-b795f1c67bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.374317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b88ac-427e-4976-9760-b795f1c67bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.374590 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b88ac-427e-4976-9760-b795f1c67bd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.384808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b88ac-427e-4976-9760-b795f1c67bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-be1b88ac-427e-4976-9760-b795f1c67bd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:05.392423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:05.393390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:05.394722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 329/671] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:05.395423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2423f8-ca6d-4dc9-a19c-b54da5148384 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.395585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2423f8-ca6d-4dc9-a19c-b54da5148384 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.395924 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2423f8-ca6d-4dc9-a19c-b54da5148384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.413823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-5d2423f8-ca6d-4dc9-a19c-b54da5148384 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:05.414994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5d2423f8-ca6d-4dc9-a19c-b54da5148384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:05.454271 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebe394-2df6-4eee-adda-ff55b70ba5af None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:05.478772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 330/672] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:05.479579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2423f8-ca6d-4dc9-a19c-b54da5148384 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:05.487950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524cc46-611c-4565-a227-03bec91647cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:05.488641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cc46-611c-4565-a227-03bec91647cb None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.488929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cc46-611c-4565-a227-03bec91647cb None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.489210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524cc46-611c-4565-a227-03bec91647cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.490035 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524cc46-611c-4565-a227-03bec91647cb None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=7ee61aece9c64e74806248e4ac49cd47) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:05.490353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524cc46-611c-4565-a227-03bec91647cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:05.491772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524cc46-611c-4565-a227-03bec91647cb None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:05.504609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 343/673] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:05 2022] GET /identity/v3/role_assignments?user.id=7ee61aece9c64e74806248e4ac49cd47&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:05.504609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524cc46-611c-4565-a227-03bec91647cb None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:05.564087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:05.618337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2423f8-ca6d-4dc9-a19c-b54da5148384 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:05.623767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524cc46-611c-4565-a227-03bec91647cb None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:05.638659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:05.661294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a94ab-20b8-48e1-aac8-d943607f8415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:05.661964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a94ab-20b8-48e1-aac8-d943607f8415 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.662247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a94ab-20b8-48e1-aac8-d943607f8415 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.662352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725a07a-6f23-409c-b128-d13edf069089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:05.662559 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a94ab-20b8-48e1-aac8-d943607f8415 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.662932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725a07a-6f23-409c-b128-d13edf069089 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.663221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725a07a-6f23-409c-b128-d13edf069089 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.663323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a94ab-20b8-48e1-aac8-d943607f8415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:05.663504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725a07a-6f23-409c-b128-d13edf069089 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.663600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a94ab-20b8-48e1-aac8-d943607f8415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:05.664265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725a07a-6f23-409c-b128-d13edf069089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:05.665103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725a07a-6f23-409c-b128-d13edf069089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:05.665209 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a94ab-20b8-48e1-aac8-d943607f8415 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:05.665941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725a07a-6f23-409c-b128-d13edf069089 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:05.678248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 331/674] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:05.679592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a94ab-20b8-48e1-aac8-d943607f8415 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:05.683148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 344/675] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:05.684089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725a07a-6f23-409c-b128-d13edf069089 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:05.792034 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725a07a-6f23-409c-b128-d13edf069089 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:05.793072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a94ab-20b8-48e1-aac8-d943607f8415 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:05.805664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:05.827908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d96b8-bae1-4352-88ad-65a9fea8121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:05.828258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe23217-c732-4b33-be1b-0bc94d5d55d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:05.828723 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d96b8-bae1-4352-88ad-65a9fea8121a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.828928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d96b8-bae1-4352-88ad-65a9fea8121a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.829087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe23217-c732-4b33-be1b-0bc94d5d55d7 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.829179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d96b8-bae1-4352-88ad-65a9fea8121a None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.829323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe23217-c732-4b33-be1b-0bc94d5d55d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.829599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe23217-c732-4b33-be1b-0bc94d5d55d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.829896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d96b8-bae1-4352-88ad-65a9fea8121a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:05.830207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d96b8-bae1-4352-88ad-65a9fea8121a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:05.831638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d96b8-bae1-4352-88ad-65a9fea8121a None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:05.841018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe23217-c732-4b33-be1b-0bc94d5d55d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:05.847185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 332/676] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:05.847185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d96b8-bae1-4352-88ad-65a9fea8121a None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-ebe23217-c732-4b33-be1b-0bc94d5d55d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:05.850592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:05.851481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:05.852376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 345/677] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:05.853064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe23217-c732-4b33-be1b-0bc94d5d55d7 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:05.891180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:05.954517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d96b8-bae1-4352-88ad-65a9fea8121a None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:05.961022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe23217-c732-4b33-be1b-0bc94d5d55d7 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:05.989577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49117d2-9c9f-4974-908a-507a56c11beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:05.990489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49117d2-9c9f-4974-908a-507a56c11beb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.990786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49117d2-9c9f-4974-908a-507a56c11beb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.991066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49117d2-9c9f-4974-908a-507a56c11beb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:05.997681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc74cea-987e-46db-a34b-6b9500607dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:05.997947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49117d2-9c9f-4974-908a-507a56c11beb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:05.998797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc74cea-987e-46db-a34b-6b9500607dfa None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:05.999253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc74cea-987e-46db-a34b-6b9500607dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:05.999405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49117d2-9c9f-4974-908a-507a56c11beb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:05.999813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc74cea-987e-46db-a34b-6b9500607dfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:06.006709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc74cea-987e-46db-a34b-6b9500607dfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:06.008317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc74cea-987e-46db-a34b-6b9500607dfa None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-b49117d2-9c9f-4974-908a-507a56c11beb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:06.013597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:06.014483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:06.015367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:06.015367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:06.015367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:06.015367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:06.015367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:06.015367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:06.015367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:06.015367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:06.020030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 333/678] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:06.020922 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49117d2-9c9f-4974-908a-507a56c11beb None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-8cc74cea-987e-46db-a34b-6b9500607dfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:06.027099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:06.028168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:06.029256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:06.029256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:06.029256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:06.029256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:06.029256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:06.029256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:06.029256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:06.029256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:06.031438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 346/679] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:06.032445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc74cea-987e-46db-a34b-6b9500607dfa None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:06.067330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:06.130041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:06.133756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49117d2-9c9f-4974-908a-507a56c11beb None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:06.147804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc74cea-987e-46db-a34b-6b9500607dfa None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:06.171766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae4caa-ff47-4b2f-ad23-e17da47a20a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:06.172585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae4caa-ff47-4b2f-ad23-e17da47a20a6 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:06.172871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae4caa-ff47-4b2f-ad23-e17da47a20a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:06.173145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae4caa-ff47-4b2f-ad23-e17da47a20a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:06.182293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed5573-4b33-4228-8689-7b1849c7fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:06.182957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed5573-4b33-4228-8689-7b1849c7fdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:06.183243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed5573-4b33-4228-8689-7b1849c7fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:06.183582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed5573-4b33-4228-8689-7b1849c7fdd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:06.183887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae4caa-ff47-4b2f-ad23-e17da47a20a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:06.184361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed5573-4b33-4228-8689-7b1849c7fdd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:06.184672 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed5573-4b33-4228-8689-7b1849c7fdd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:06.185400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae4caa-ff47-4b2f-ad23-e17da47a20a6 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:06.186025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed5573-4b33-4228-8689-7b1849c7fdd6 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:06.195290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 347/680] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:06.196909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed5573-4b33-4228-8689-7b1849c7fdd6 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-cfae4caa-ff47-4b2f-ad23-e17da47a20a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:06.203778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:06.204687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:06.206338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:06.206338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:06.206338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:06.206338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:06.206338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 334/681] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:06.206338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae4caa-ff47-4b2f-ad23-e17da47a20a6 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:06.304136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:06.304815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae4caa-ff47-4b2f-ad23-e17da47a20a6 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:06.313430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed5573-4b33-4228-8689-7b1849c7fdd6 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:06.339756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cd4a4-5cf1-4c54-94f4-9c7f6b471832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:06.340402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd4a4-5cf1-4c54-94f4-9c7f6b471832 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:06.340691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd4a4-5cf1-4c54-94f4-9c7f6b471832 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:06.341238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cd4a4-5cf1-4c54-94f4-9c7f6b471832 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:06.342026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cd4a4-5cf1-4c54-94f4-9c7f6b471832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:06.342337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cd4a4-5cf1-4c54-94f4-9c7f6b471832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:06.343783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4cd4a4-5cf1-4c54-94f4-9c7f6b471832 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:06.354669 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bdd58-04b0-4cba-8eab-635cfc1a7b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:06.355343 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bdd58-04b0-4cba-8eab-635cfc1a7b8a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:06.355630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bdd58-04b0-4cba-8eab-635cfc1a7b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:06.355911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bdd58-04b0-4cba-8eab-635cfc1a7b8a None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:06.361383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 335/682] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:06.361530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bdd58-04b0-4cba-8eab-635cfc1a7b8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:06.361530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bdd58-04b0-4cba-8eab-635cfc1a7b8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:06.361668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cd4a4-5cf1-4c54-94f4-9c7f6b471832 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:06.361746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bdd58-04b0-4cba-8eab-635cfc1a7b8a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:06.373187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 348/683] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:06.374014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bdd58-04b0-4cba-8eab-635cfc1a7b8a None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:06.381469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:06.469288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cd4a4-5cf1-4c54-94f4-9c7f6b471832 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:06.482049 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bdd58-04b0-4cba-8eab-635cfc1a7b8a None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:06.506678 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e891a-c069-4281-9475-a0d4be0a80bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:06.508018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e891a-c069-4281-9475-a0d4be0a80bf None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:06.508534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e891a-c069-4281-9475-a0d4be0a80bf None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:06.508908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e891a-c069-4281-9475-a0d4be0a80bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:06.515138 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756feeb9-073f-45d3-a9f1-265f090e91f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:06.515791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756feeb9-073f-45d3-a9f1-265f090e91f9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:06.516106 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756feeb9-073f-45d3-a9f1-265f090e91f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:06.516383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756feeb9-073f-45d3-a9f1-265f090e91f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:06.517102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756feeb9-073f-45d3-a9f1-265f090e91f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:06.517410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756feeb9-073f-45d3-a9f1-265f090e91f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:06.518814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756feeb9-073f-45d3-a9f1-265f090e91f9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:06.521021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e891a-c069-4281-9475-a0d4be0a80bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:06.522451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e891a-c069-4281-9475-a0d4be0a80bf None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:06.533978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 349/684] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:06.533978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756feeb9-073f-45d3-a9f1-265f090e91f9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-0c7e891a-c069-4281-9475-a0d4be0a80bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:06.546405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:06.547299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:06.548233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:06.548233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:06.548233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:06.548233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:06.548233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 336/685] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:06.548537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e891a-c069-4281-9475-a0d4be0a80bf None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:06.553272 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:06.615513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:06.642574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756feeb9-073f-45d3-a9f1-265f090e91f9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:06.662480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e891a-c069-4281-9475-a0d4be0a80bf None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:06.678578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8f30c-07c6-4641-90dd-a84ad173d4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:06.679237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8f30c-07c6-4641-90dd-a84ad173d4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:06.679656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8f30c-07c6-4641-90dd-a84ad173d4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:06.679993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8f30c-07c6-4641-90dd-a84ad173d4e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:06.680790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8f30c-07c6-4641-90dd-a84ad173d4e9 None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=b0e658f3947f41a9a3e09ea327b5d8bc) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:06.681105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8f30c-07c6-4641-90dd-a84ad173d4e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:06.682519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8f30c-07c6-4641-90dd-a84ad173d4e9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:06.695993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 350/686] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:06 2022] GET /identity/v3/role_assignments?user.id=b0e658f3947f41a9a3e09ea327b5d8bc&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:06.695993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8f30c-07c6-4641-90dd-a84ad173d4e9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:06.711996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a7fee-6fcc-4ddb-a285-62d51808c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:06.712854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a7fee-6fcc-4ddb-a285-62d51808c80c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:06.713278 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a7fee-6fcc-4ddb-a285-62d51808c80c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:06.713570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a7fee-6fcc-4ddb-a285-62d51808c80c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:06.714615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a7fee-6fcc-4ddb-a285-62d51808c80c None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=9c142f4d77b54982abcd4b76edbcb4c4) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:06.714938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a7fee-6fcc-4ddb-a285-62d51808c80c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:06.717099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a7fee-6fcc-4ddb-a285-62d51808c80c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:06.725909 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 337/687] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:06 2022] GET /identity/v3/role_assignments?user.id=9c142f4d77b54982abcd4b76edbcb4c4&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:06.726825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a7fee-6fcc-4ddb-a285-62d51808c80c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:06.795489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:06.867061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a7fee-6fcc-4ddb-a285-62d51808c80c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:06.894584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8f30c-07c6-4641-90dd-a84ad173d4e9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:06.903722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:06.918363 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dc696-86d9-4b67-81e5-88034008ca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:06.919399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dc696-86d9-4b67-81e5-88034008ca4d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:06.919684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dc696-86d9-4b67-81e5-88034008ca4d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:06.919986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dc696-86d9-4b67-81e5-88034008ca4d None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:06.920722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dc696-86d9-4b67-81e5-88034008ca4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:06.921032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dc696-86d9-4b67-81e5-88034008ca4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:06.922429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dc696-86d9-4b67-81e5-88034008ca4d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:06.938832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 338/688] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:06.943621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dc696-86d9-4b67-81e5-88034008ca4d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:06.954077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a9783-0d92-48ef-a581-a54ea6ba9f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:06.955200 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9783-0d92-48ef-a581-a54ea6ba9f4e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:06.955740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9783-0d92-48ef-a581-a54ea6ba9f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:06.956772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9783-0d92-48ef-a581-a54ea6ba9f4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:06.972020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a9783-0d92-48ef-a581-a54ea6ba9f4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:06.973927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a9783-0d92-48ef-a581-a54ea6ba9f4e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-0e0a9783-0d92-48ef-a581-a54ea6ba9f4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:06.995121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:06.996165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:06.997137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:06.997137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:06.997137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:06.997137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:06.997137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:06.997137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:06.997137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:06.997137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:06.997137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:06.997137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:07.000067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 351/689] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 16 00:12:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:07.002240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a9783-0d92-48ef-a581-a54ea6ba9f4e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:07.072059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dc696-86d9-4b67-81e5-88034008ca4d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:07.108070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a9783-0d92-48ef-a581-a54ea6ba9f4e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:07.110638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febceaad-dbf3-4a5a-bcff-9522594182dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:07.111738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febceaad-dbf3-4a5a-bcff-9522594182dc None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:07.112802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febceaad-dbf3-4a5a-bcff-9522594182dc None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:07.113319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febceaad-dbf3-4a5a-bcff-9522594182dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:07.121963 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febceaad-dbf3-4a5a-bcff-9522594182dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:07.123757 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febceaad-dbf3-4a5a-bcff-9522594182dc None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-febceaad-dbf3-4a5a-bcff-9522594182dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:07.140168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:07.141164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:07.142099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:07.142099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:07.142099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:07.142099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:07.142099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:07.142099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:07.142099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:07.142099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:07.142099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:12:07.142099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:07.144856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 339/690] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:07.150129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669c5dd-e6e2-47fd-a7d3-917c182ba20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:07.150852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669c5dd-e6e2-47fd-a7d3-917c182ba20e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:07.151149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669c5dd-e6e2-47fd-a7d3-917c182ba20e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:07.151428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669c5dd-e6e2-47fd-a7d3-917c182ba20e None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:07.152303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669c5dd-e6e2-47fd-a7d3-917c182ba20e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:07.152615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669c5dd-e6e2-47fd-a7d3-917c182ba20e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:07.154055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669c5dd-e6e2-47fd-a7d3-917c182ba20e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:07.158488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febceaad-dbf3-4a5a-bcff-9522594182dc None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:07.164113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:07.175775 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 352/691] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 16 00:12:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:07.181313 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669c5dd-e6e2-47fd-a7d3-917c182ba20e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:07.215669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:07.271422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febceaad-dbf3-4a5a-bcff-9522594182dc None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:07.284737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669c5dd-e6e2-47fd-a7d3-917c182ba20e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:07.309411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc6c60-0a2e-491a-816f-00cf834eb315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:07.310455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc6c60-0a2e-491a-816f-00cf834eb315 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:07.310972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc6c60-0a2e-491a-816f-00cf834eb315 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:07.311630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc6c60-0a2e-491a-816f-00cf834eb315 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:07.312737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc6c60-0a2e-491a-816f-00cf834eb315 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:07.313261 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc6c60-0a2e-491a-816f-00cf834eb315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:07.314917 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc6c60-0a2e-491a-816f-00cf834eb315 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:07.334534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 340/692] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 16 00:12:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:07.340443 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc6c60-0a2e-491a-816f-00cf834eb315 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:07.341116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c7940-99f9-44e3-b299-50018fbea629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:07.341837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c7940-99f9-44e3-b299-50018fbea629 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:07.342163 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c7940-99f9-44e3-b299-50018fbea629 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:07.342402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c7940-99f9-44e3-b299-50018fbea629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:07.448173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc6c60-0a2e-491a-816f-00cf834eb315 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:07.452332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:07.457096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:07.466437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c7940-99f9-44e3-b299-50018fbea629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:07.467933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c7940-99f9-44e3-b299-50018fbea629 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:07.487697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0ee28-4301-4289-93bd-a8bae86027fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:07.488748 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0ee28-4301-4289-93bd-a8bae86027fc None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:07.489245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0ee28-4301-4289-93bd-a8bae86027fc None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:07.489729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0ee28-4301-4289-93bd-a8bae86027fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:07.562314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0ee28-4301-4289-93bd-a8bae86027fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:07.564167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0ee28-4301-4289-93bd-a8bae86027fc None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:07.639189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 353/693] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:07.644937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c7940-99f9-44e3-b299-50018fbea629 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:07.708465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 341/694] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:12:07.712038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0ee28-4301-4289-93bd-a8bae86027fc None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:07.722432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:07.822336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0ee28-4301-4289-93bd-a8bae86027fc None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:07.827292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:07.836612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c7940-99f9-44e3-b299-50018fbea629 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:07.886320 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790697b-e458-42f8-9ac4-2b0c6144f6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:07.887416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790697b-e458-42f8-9ac4-2b0c6144f6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:07.887776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790697b-e458-42f8-9ac4-2b0c6144f6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:07.888153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790697b-e458-42f8-9ac4-2b0c6144f6f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:07.901937 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790697b-e458-42f8-9ac4-2b0c6144f6f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:07.903588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790697b-e458-42f8-9ac4-2b0c6144f6f5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-f790697b-e458-42f8-9ac4-2b0c6144f6f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:07.931281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:07.932239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:07.933114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:07.933114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:07.933114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:07.933114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:07.933332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 342/695] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:07.949072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8df6-b1e6-4b40-b710-81a641831cb5 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:07.955073 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc866a56-cfd5-4b2a-8640-9d48e7858c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:07.956509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc866a56-cfd5-4b2a-8640-9d48e7858c45 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:07.957492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc866a56-cfd5-4b2a-8640-9d48e7858c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:07.957959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc866a56-cfd5-4b2a-8640-9d48e7858c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:07.959170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8df6-b1e6-4b40-b710-81a641831cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:07.959617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be8df6-b1e6-4b40-b710-81a641831cb5 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:07.966612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 343/696] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:07 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:07.966612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8df6-b1e6-4b40-b710-81a641831cb5 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:07.986287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc866a56-cfd5-4b2a-8640-9d48e7858c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:07.991315 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc866a56-cfd5-4b2a-8640-9d48e7858c45 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-fc866a56-cfd5-4b2a-8640-9d48e7858c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:08.035913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:08.036927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:08.037835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:08.037835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:08.037835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:08.037835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:08.040686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 354/697] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:08.042400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec6e8-7179-4c8a-b6bd-f586f472c012 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:08.043441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec6e8-7179-4c8a-b6bd-f586f472c012 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:08.043948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bec6e8-7179-4c8a-b6bd-f586f472c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:08.064932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-f0bec6e8-7179-4c8a-b6bd-f586f472c012 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:08.066964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f0bec6e8-7179-4c8a-b6bd-f586f472c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:08.084110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:08.139436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be8df6-b1e6-4b40-b710-81a641831cb5 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:08.164074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 355/698] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:08.165326 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bec6e8-7179-4c8a-b6bd-f586f472c012 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:08.191726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5782a81-94d9-440a-83e7-2eddd7d4cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:08.193137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782a81-94d9-440a-83e7-2eddd7d4cff2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:08.193580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782a81-94d9-440a-83e7-2eddd7d4cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:08.194415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782a81-94d9-440a-83e7-2eddd7d4cff2 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:08.195592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5782a81-94d9-440a-83e7-2eddd7d4cff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:08.196100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5782a81-94d9-440a-83e7-2eddd7d4cff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:08.197804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5782a81-94d9-440a-83e7-2eddd7d4cff2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:08.214026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 344/699] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:08.219687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5782a81-94d9-440a-83e7-2eddd7d4cff2 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:08.313342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:08.355718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bec6e8-7179-4c8a-b6bd-f586f472c012 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:08.385039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5782a81-94d9-440a-83e7-2eddd7d4cff2 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:08.406432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:08.414548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbf8fe-c80d-4949-b310-9b0bf3c28abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:08.415273 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbf8fe-c80d-4949-b310-9b0bf3c28abe None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:08.415562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbf8fe-c80d-4949-b310-9b0bf3c28abe None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:08.415840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbf8fe-c80d-4949-b310-9b0bf3c28abe None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:08.416782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbf8fe-c80d-4949-b310-9b0bf3c28abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:08.417073 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbf8fe-c80d-4949-b310-9b0bf3c28abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:08.418439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbf8fe-c80d-4949-b310-9b0bf3c28abe None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:08.438300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 356/700] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:08.438300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbf8fe-c80d-4949-b310-9b0bf3c28abe None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:08.438555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3627b92-4afd-4b84-b292-b5d91e69a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:08.438555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3627b92-4afd-4b84-b292-b5d91e69a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:08.438555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3627b92-4afd-4b84-b292-b5d91e69a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:08.438555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3627b92-4afd-4b84-b292-b5d91e69a9f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:08.459123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3627b92-4afd-4b84-b292-b5d91e69a9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:08.461000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3627b92-4afd-4b84-b292-b5d91e69a9f2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-e3627b92-4afd-4b84-b292-b5d91e69a9f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:08.486649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:08.487617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:08.488550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:08.488550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:08.488550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:08.488550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:08.492200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 345/701] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:08.493231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3627b92-4afd-4b84-b292-b5d91e69a9f2 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:08.594564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbf8fe-c80d-4949-b310-9b0bf3c28abe None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:08.625819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3627b92-4afd-4b84-b292-b5d91e69a9f2 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:08.637097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9bd65-b14a-4530-9ebe-0c4604620d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:08.637897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9bd65-b14a-4530-9ebe-0c4604620d64 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:08.638473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9bd65-b14a-4530-9ebe-0c4604620d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:08.638741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9bd65-b14a-4530-9ebe-0c4604620d64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:08.647117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9bd65-b14a-4530-9ebe-0c4604620d64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:08.648697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9bd65-b14a-4530-9ebe-0c4604620d64 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:08.651679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-82b9bd65-b14a-4530-9ebe-0c4604620d64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:08.674542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:08.675756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:08.676741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:08.676741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:08.676741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:08.676741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:08.676741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:08.676741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:08.676741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:08.676741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:08.676741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 357/702] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:08.676741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9bd65-b14a-4530-9ebe-0c4604620d64 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:08.745212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c662c-e1ff-402d-b98a-e73c09800c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:08.745212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c662c-e1ff-402d-b98a-e73c09800c68 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:08.745212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c662c-e1ff-402d-b98a-e73c09800c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:08.745212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c662c-e1ff-402d-b98a-e73c09800c68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:08.771989 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c662c-e1ff-402d-b98a-e73c09800c68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:08.771989 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c662c-e1ff-402d-b98a-e73c09800c68 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-4e4c662c-e1ff-402d-b98a-e73c09800c68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:08.799635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:08.800616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:08.801526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:08.801526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:08.801526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:08.801526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:08.801526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:08.801526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:08.801526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:08.801526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:08.802870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 346/703] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:08.804624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c662c-e1ff-402d-b98a-e73c09800c68 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:08.855562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9bd65-b14a-4530-9ebe-0c4604620d64 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:08.867995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:08.939991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc34666-9fda-4861-8a0f-6a2276fbfe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:08.944017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc34666-9fda-4861-8a0f-6a2276fbfe23 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:08.944017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc34666-9fda-4861-8a0f-6a2276fbfe23 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:08.944416 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc34666-9fda-4861-8a0f-6a2276fbfe23 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:08.944822 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc34666-9fda-4861-8a0f-6a2276fbfe23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:08.945136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc34666-9fda-4861-8a0f-6a2276fbfe23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:08.948419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc34666-9fda-4861-8a0f-6a2276fbfe23 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:08.972377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 358/704] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:08.975991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c662c-e1ff-402d-b98a-e73c09800c68 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:08.976207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc34666-9fda-4861-8a0f-6a2276fbfe23 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:09.020960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c508-2c47-45dd-896d-e93dc2f73438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:09.021800 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c508-2c47-45dd-896d-e93dc2f73438 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:09.022085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c508-2c47-45dd-896d-e93dc2f73438 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:09.022359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c508-2c47-45dd-896d-e93dc2f73438 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:09.023151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c508-2c47-45dd-896d-e93dc2f73438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:09.023462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c508-2c47-45dd-896d-e93dc2f73438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:09.035985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c508-2c47-45dd-896d-e93dc2f73438 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:09.044266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 347/705] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:09.045151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c508-2c47-45dd-896d-e93dc2f73438 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:09.109120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:09.164560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:09.175858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc34666-9fda-4861-8a0f-6a2276fbfe23 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:09.176471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c508-2c47-45dd-896d-e93dc2f73438 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:09.217454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433be556-788d-4bff-b9aa-f77dba5c3404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:09.218347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433be556-788d-4bff-b9aa-f77dba5c3404 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:09.218639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433be556-788d-4bff-b9aa-f77dba5c3404 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:09.218924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433be556-788d-4bff-b9aa-f77dba5c3404 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:09.219492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80d4f7-920c-4560-9d7c-af910331f91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:09.219724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433be556-788d-4bff-b9aa-f77dba5c3404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:09.220148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433be556-788d-4bff-b9aa-f77dba5c3404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:09.220373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80d4f7-920c-4560-9d7c-af910331f91d None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:09.220735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80d4f7-920c-4560-9d7c-af910331f91d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:09.221084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80d4f7-920c-4560-9d7c-af910331f91d None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:09.221687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433be556-788d-4bff-b9aa-f77dba5c3404 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:09.222026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80d4f7-920c-4560-9d7c-af910331f91d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:09.223736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80d4f7-920c-4560-9d7c-af910331f91d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:09.239052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 359/706] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:09.239991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433be556-788d-4bff-b9aa-f77dba5c3404 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:09.261585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 348/707] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:12:09 2022] POST /identity/v3/users => generated 254 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:09.263257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfd00a-bbee-443b-a976-be0b1c17a6cd None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:09.263553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfd00a-bbee-443b-a976-be0b1c17a6cd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:09.263839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfd00a-bbee-443b-a976-be0b1c17a6cd None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:09.265333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 349/708] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:09.265847 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfd00a-bbee-443b-a976-be0b1c17a6cd None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:09.463256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433be556-788d-4bff-b9aa-f77dba5c3404 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:09.486594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:09.493223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfd00a-bbee-443b-a976-be0b1c17a6cd None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:09.512067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011c291-faa5-4b46-866e-ed1ed08bdde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:09.513135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011c291-faa5-4b46-866e-ed1ed08bdde0 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:09.513646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011c291-faa5-4b46-866e-ed1ed08bdde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:09.515213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011c291-faa5-4b46-866e-ed1ed08bdde0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:09.515931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011c291-faa5-4b46-866e-ed1ed08bdde0 None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=88d67d41124c4deda1c5ecdab82d3055) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:09.516311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011c291-faa5-4b46-866e-ed1ed08bdde0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:09.517955 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011c291-faa5-4b46-866e-ed1ed08bdde0 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:09.535262 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 360/709] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:09 2022] GET /identity/v3/role_assignments?user.id=88d67d41124c4deda1c5ecdab82d3055&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:09.536935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e838ff-9110-47ef-894a-14e56816894e None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:09.536935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e838ff-9110-47ef-894a-14e56816894e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:09.537153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e838ff-9110-47ef-894a-14e56816894e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:09.542373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21621e89-5f15-4361-a449-5757ad881ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:09.543870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21621e89-5f15-4361-a449-5757ad881ccc None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:09.544172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21621e89-5f15-4361-a449-5757ad881ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:09.544454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21621e89-5f15-4361-a449-5757ad881ccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:09.545319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21621e89-5f15-4361-a449-5757ad881ccc None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=cd57046b084b463488296b825097081d) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:09.545637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21621e89-5f15-4361-a449-5757ad881ccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:09.547866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21621e89-5f15-4361-a449-5757ad881ccc None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:09.554762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 350/710] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:09 2022] GET /identity/v3/role_assignments?user.id=cd57046b084b463488296b825097081d&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:09.558134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c206f-9c7d-481d-af05-e1cf68993cad None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:09.558501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c206f-9c7d-481d-af05-e1cf68993cad None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:09.558786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c206f-9c7d-481d-af05-e1cf68993cad None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:09.561150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 351/711] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:09.569434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eb7d0-3b38-441f-9785-94ac7d3de339 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:09.569818 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eb7d0-3b38-441f-9785-94ac7d3de339 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:09.570384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eb7d0-3b38-441f-9785-94ac7d3de339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:09.580062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d1e838ff-9110-47ef-894a-14e56816894e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:09.580062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d1e838ff-9110-47ef-894a-14e56816894e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:09.612620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-630eb7d0-3b38-441f-9785-94ac7d3de339 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:09.613779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-630eb7d0-3b38-441f-9785-94ac7d3de339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:09.624659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:09.748474 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 361/712] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:09.769182 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 352/713] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:09.780843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e838ff-9110-47ef-894a-14e56816894e None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:09.793024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eb7d0-3b38-441f-9785-94ac7d3de339 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:09.913102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eb7d0-3b38-441f-9785-94ac7d3de339 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:09.923431 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e838ff-9110-47ef-894a-14e56816894e None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:09.949559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:09.963612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d658447-d538-40b9-882a-99acb742494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:09.964461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d658447-d538-40b9-882a-99acb742494f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:09.964747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d658447-d538-40b9-882a-99acb742494f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:09.965026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d658447-d538-40b9-882a-99acb742494f None admin] PATH_INFO: `/v3/services/network` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:09.965938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d658447-d538-40b9-882a-99acb742494f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:09.967336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d658447-d538-40b9-882a-99acb742494f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:09.986119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68407bc-2183-45fb-a418-9e626a2a93a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:09.986946 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68407bc-2183-45fb-a418-9e626a2a93a3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:09.987765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68407bc-2183-45fb-a418-9e626a2a93a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-3d658447-d538-40b9-882a-99acb742494f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:09.987871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:09.989059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:12:09.989952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:09.990700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68407bc-2183-45fb-a418-9e626a2a93a3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:09.990700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68407bc-2183-45fb-a418-9e626a2a93a3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:09.990700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68407bc-2183-45fb-a418-9e626a2a93a3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:09.991430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 353/714] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:09 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:09.997244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d658447-d538-40b9-882a-99acb742494f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:10.002104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-e68407bc-2183-45fb-a418-9e626a2a93a3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:10.017426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:10.018503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:12:10.019360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:10.028535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 362/715] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Jun 16 00:12:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:10.040407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68407bc-2183-45fb-a418-9e626a2a93a3 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:10.134005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d658447-d538-40b9-882a-99acb742494f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:10.175427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfce723-c008-4a94-a537-26e6b7ef525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:10.176510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfce723-c008-4a94-a537-26e6b7ef525d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:10.177030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfce723-c008-4a94-a537-26e6b7ef525d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:10.177542 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfce723-c008-4a94-a537-26e6b7ef525d None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:10.178647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfce723-c008-4a94-a537-26e6b7ef525d None admin] RBAC: Adding query filter params (name=network) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:10.184654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfce723-c008-4a94-a537-26e6b7ef525d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:10.186777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfce723-c008-4a94-a537-26e6b7ef525d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:10.198954 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 354/716] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:10.204651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfce723-c008-4a94-a537-26e6b7ef525d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:10.290058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68407bc-2183-45fb-a418-9e626a2a93a3 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:10.299371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:10.341812 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfce723-c008-4a94-a537-26e6b7ef525d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:10.383427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b9ad7-f73d-436a-90cf-955e0a8fd2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:10.384539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b9ad7-f73d-436a-90cf-955e0a8fd2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:10.385226 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b9ad7-f73d-436a-90cf-955e0a8fd2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:10.385731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b9ad7-f73d-436a-90cf-955e0a8fd2f7 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:10.386707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b9ad7-f73d-436a-90cf-955e0a8fd2f7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:10.387242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b9ad7-f73d-436a-90cf-955e0a8fd2f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:10.389015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b9ad7-f73d-436a-90cf-955e0a8fd2f7 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:10.396724 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 355/717] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:10.428800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd51a68-e150-4a74-be84-41dee12d69f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:10.429509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd51a68-e150-4a74-be84-41dee12d69f8 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:10.429799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd51a68-e150-4a74-be84-41dee12d69f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:10.430082 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd51a68-e150-4a74-be84-41dee12d69f8 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:10.430807 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd51a68-e150-4a74-be84-41dee12d69f8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:10.431121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd51a68-e150-4a74-be84-41dee12d69f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:10.432583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd51a68-e150-4a74-be84-41dee12d69f8 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:10.439449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 363/718] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 16 00:12:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:10.445199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b9ad7-f73d-436a-90cf-955e0a8fd2f7 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:10.667795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b9ad7-f73d-436a-90cf-955e0a8fd2f7 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:10.720000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:10.725593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ca342-5d38-4826-bc51-f713f7fb0b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:10.726363 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca342-5d38-4826-bc51-f713f7fb0b03 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:10.726651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca342-5d38-4826-bc51-f713f7fb0b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:10.726935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ca342-5d38-4826-bc51-f713f7fb0b03 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:10.727657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ca342-5d38-4826-bc51-f713f7fb0b03 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:10.727987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ca342-5d38-4826-bc51-f713f7fb0b03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:10.729370 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ca342-5d38-4826-bc51-f713f7fb0b03 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:10.734922 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 356/719] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 16 00:12:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:12.211363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dda7db-b9f2-4923-96bf-13856bd6fc0c None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:12.211363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dda7db-b9f2-4923-96bf-13856bd6fc0c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:12.211363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dda7db-b9f2-4923-96bf-13856bd6fc0c None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:12.212554 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 364/720] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:12.219783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb6e89-0290-4736-90d0-52f7fb254195 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:12.220746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb6e89-0290-4736-90d0-52f7fb254195 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:12.221237 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb6e89-0290-4736-90d0-52f7fb254195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:12.244467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-abdb6e89-0290-4736-90d0-52f7fb254195 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:12.246239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-abdb6e89-0290-4736-90d0-52f7fb254195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:12.288634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e013-204c-4683-a115-9ccabf53c7bd None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:12.289270 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e013-204c-4683-a115-9ccabf53c7bd None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:12.289752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e013-204c-4683-a115-9ccabf53c7bd None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:12.291310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 365/721] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:12.298274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9643720-d71b-4847-a92c-ece55e60794a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:12.298841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9643720-d71b-4847-a92c-ece55e60794a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:12.299327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9643720-d71b-4847-a92c-ece55e60794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:12.325908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d9643720-d71b-4847-a92c-ece55e60794a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:12.328140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d9643720-d71b-4847-a92c-ece55e60794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:12.370298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 357/722] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:12:12.403419 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb6e89-0290-4736-90d0-52f7fb254195 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:12.461685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:12.539360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb6e89-0290-4736-90d0-52f7fb254195 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:12.576343 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:12.583832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77fed8-e5c6-4656-ac91-d26daa2bbd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:12.585244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77fed8-e5c6-4656-ac91-d26daa2bbd25 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:12.585739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77fed8-e5c6-4656-ac91-d26daa2bbd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:12.586243 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77fed8-e5c6-4656-ac91-d26daa2bbd25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:12.587082 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 366/723] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:12:12.599576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77fed8-e5c6-4656-ac91-d26daa2bbd25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-2c77fed8-e5c6-4656-ac91-d26daa2bbd25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:12.609571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:12.610487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:12.611341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:12.614653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 358/724] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:12.621056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9643720-d71b-4847-a92c-ece55e60794a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:12.621733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77fed8-e5c6-4656-ac91-d26daa2bbd25 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:12.746660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77fed8-e5c6-4656-ac91-d26daa2bbd25 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:12.794204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa0c4a-f4ce-4e4c-af46-6053632c8c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:12.795386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa0c4a-f4ce-4e4c-af46-6053632c8c4a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:12.796989 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa0c4a-f4ce-4e4c-af46-6053632c8c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:12.797659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa0c4a-f4ce-4e4c-af46-6053632c8c4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:12.819604 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa0c4a-f4ce-4e4c-af46-6053632c8c4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-23aa0c4a-f4ce-4e4c-af46-6053632c8c4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:12.833855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:12.834823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:12.835742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:12.838901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 359/725] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:12.840515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b5f7-5bdd-4d42-8954-445b2a03b31e None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:12.841279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b5f7-5bdd-4d42-8954-445b2a03b31e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:12.841761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b5f7-5bdd-4d42-8954-445b2a03b31e None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:12.843472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 360/726] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:12.845901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18b5f7-5bdd-4d42-8954-445b2a03b31e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:12.882845 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9643720-d71b-4847-a92c-ece55e60794a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:12.925916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:12.931237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c41f9e-74e9-4edb-b3cc-9c7009435512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:12.931936 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c41f9e-74e9-4edb-b3cc-9c7009435512 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:12.932429 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c41f9e-74e9-4edb-b3cc-9c7009435512 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:12.932759 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c41f9e-74e9-4edb-b3cc-9c7009435512 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:12.933878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c41f9e-74e9-4edb-b3cc-9c7009435512 None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:12.934196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c41f9e-74e9-4edb-b3cc-9c7009435512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:12.936921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c41f9e-74e9-4edb-b3cc-9c7009435512 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:12.951403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 367/727] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:12.951403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d28f2-44b1-407c-95f7-cca10b35de90 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:12.951403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d28f2-44b1-407c-95f7-cca10b35de90 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:12.951403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d28f2-44b1-407c-95f7-cca10b35de90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:12.968518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ee3d28f2-44b1-407c-95f7-cca10b35de90 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:12.970000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ee3d28f2-44b1-407c-95f7-cca10b35de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:13.006806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:13.038681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18b5f7-5bdd-4d42-8954-445b2a03b31e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:13.065344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 368/728] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:13.066400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d28f2-44b1-407c-95f7-cca10b35de90 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:13.092002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca397d-2a4c-4a8a-b56c-cf0b3a62ae68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:13.092917 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca397d-2a4c-4a8a-b56c-cf0b3a62ae68 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:13.093201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca397d-2a4c-4a8a-b56c-cf0b3a62ae68 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:13.093475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca397d-2a4c-4a8a-b56c-cf0b3a62ae68 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:13.094531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca397d-2a4c-4a8a-b56c-cf0b3a62ae68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:13.094846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca397d-2a4c-4a8a-b56c-cf0b3a62ae68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:13.096254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca397d-2a4c-4a8a-b56c-cf0b3a62ae68 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:13.108694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 361/729] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:13.109527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b4d56-d554-4179-b49d-613e0e9d6120 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:13.109819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b4d56-d554-4179-b49d-613e0e9d6120 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:13.110547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b4d56-d554-4179-b49d-613e0e9d6120 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:13.116102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 362/730] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:13.119157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b4d56-d554-4179-b49d-613e0e9d6120 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:13.208187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d28f2-44b1-407c-95f7-cca10b35de90 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:13.255166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d66353-0e90-4fc2-aee9-d9a57c637c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:13.255991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d66353-0e90-4fc2-aee9-d9a57c637c96 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:13.256315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b4d56-d554-4179-b49d-613e0e9d6120 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:13.256705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d66353-0e90-4fc2-aee9-d9a57c637c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:13.256705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d66353-0e90-4fc2-aee9-d9a57c637c96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:13.268999 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:13.270197 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d66353-0e90-4fc2-aee9-d9a57c637c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:13.271781 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d66353-0e90-4fc2-aee9-d9a57c637c96 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-b3d66353-0e90-4fc2-aee9-d9a57c637c96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:13.293501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:13.294495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:13.295419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:13.295419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:13.295419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:13.295419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:13.295419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 369/731] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:13.295712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d66353-0e90-4fc2-aee9-d9a57c637c96 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:13.304381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ff083-9bff-491b-a0c2-60bff5d168db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:13.305189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff083-9bff-491b-a0c2-60bff5d168db None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:13.305477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff083-9bff-491b-a0c2-60bff5d168db None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:13.305750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff083-9bff-491b-a0c2-60bff5d168db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:13.319145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:13.325570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ff083-9bff-491b-a0c2-60bff5d168db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-915ff083-9bff-491b-a0c2-60bff5d168db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:13.333469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:13.334424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:13.335286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 363/732] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:13.336576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca48a4-eadc-44e0-a823-0c066c815e24 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:13.336576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca48a4-eadc-44e0-a823-0c066c815e24 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:13.336752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca48a4-eadc-44e0-a823-0c066c815e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:13.355386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-fbca48a4-eadc-44e0-a823-0c066c815e24 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:13.356972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fbca48a4-eadc-44e0-a823-0c066c815e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:13.441410 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 364/733] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:13.441614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d66353-0e90-4fc2-aee9-d9a57c637c96 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:13.442712 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca48a4-eadc-44e0-a823-0c066c815e24 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:13.486115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d393a3-32ee-4c83-b87d-226f32ca27af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:13.487051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d393a3-32ee-4c83-b87d-226f32ca27af None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:13.487837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d393a3-32ee-4c83-b87d-226f32ca27af None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:13.488271 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d393a3-32ee-4c83-b87d-226f32ca27af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:13.500933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d393a3-32ee-4c83-b87d-226f32ca27af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:13.502463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d393a3-32ee-4c83-b87d-226f32ca27af None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-c5d393a3-32ee-4c83-b87d-226f32ca27af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:13.522476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:13.523575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:13.524699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:13.524699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:13.524699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:13.524699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:13.530838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 370/734] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:13.533471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d393a3-32ee-4c83-b87d-226f32ca27af None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:13.554221 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:13.558541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca48a4-eadc-44e0-a823-0c066c815e24 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:13.603090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f097fc-aca6-4784-8180-bc14cf3153bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:13.603864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f097fc-aca6-4784-8180-bc14cf3153bf None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:13.604218 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f097fc-aca6-4784-8180-bc14cf3153bf None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:13.604502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f097fc-aca6-4784-8180-bc14cf3153bf None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:13.605403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f097fc-aca6-4784-8180-bc14cf3153bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:13.605701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f097fc-aca6-4784-8180-bc14cf3153bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:13.608430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f097fc-aca6-4784-8180-bc14cf3153bf None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:13.616966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:13.628335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 365/735] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:13.628335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f097fc-aca6-4784-8180-bc14cf3153bf None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:13.668417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d393a3-32ee-4c83-b87d-226f32ca27af None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:13.716329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2038f45-b584-47e3-8f71-6ed18dcc8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:13.717003 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2038f45-b584-47e3-8f71-6ed18dcc8624 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:13.717513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2038f45-b584-47e3-8f71-6ed18dcc8624 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:13.717794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2038f45-b584-47e3-8f71-6ed18dcc8624 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:13.718546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2038f45-b584-47e3-8f71-6ed18dcc8624 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:13.718852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2038f45-b584-47e3-8f71-6ed18dcc8624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:13.720263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2038f45-b584-47e3-8f71-6ed18dcc8624 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:13.731322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 371/736] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:13.732345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2038f45-b584-47e3-8f71-6ed18dcc8624 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:13.761470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f097fc-aca6-4784-8180-bc14cf3153bf None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:13.804360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d451c8-28c9-4bf9-8ea3-c1f6e2ec53da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:13.805391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d451c8-28c9-4bf9-8ea3-c1f6e2ec53da None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:13.805899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d451c8-28c9-4bf9-8ea3-c1f6e2ec53da None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:13.806277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d451c8-28c9-4bf9-8ea3-c1f6e2ec53da None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:13.807406 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d451c8-28c9-4bf9-8ea3-c1f6e2ec53da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:13.808903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d451c8-28c9-4bf9-8ea3-c1f6e2ec53da None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:13.831680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 366/737] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:12:13 2022] POST /identity/v3/services => generated 240 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:13.832714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d451c8-28c9-4bf9-8ea3-c1f6e2ec53da None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:13.862974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:13.867515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2038f45-b584-47e3-8f71-6ed18dcc8624 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:13.901513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:13.920959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a3aaf-45f7-43d7-90f3-a839b0e0c10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:13.921894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a3aaf-45f7-43d7-90f3-a839b0e0c10a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:13.922246 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a3aaf-45f7-43d7-90f3-a839b0e0c10a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:13.922593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a3aaf-45f7-43d7-90f3-a839b0e0c10a None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:13.923472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a3aaf-45f7-43d7-90f3-a839b0e0c10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:13.923852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a3aaf-45f7-43d7-90f3-a839b0e0c10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:13.926054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a3aaf-45f7-43d7-90f3-a839b0e0c10a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:13.944349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 372/738] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:13.945584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a3aaf-45f7-43d7-90f3-a839b0e0c10a None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:13.987635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d451c8-28c9-4bf9-8ea3-c1f6e2ec53da None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:14.045066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68e87d-9b9a-4de8-9844-a293500bf217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:14.046438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68e87d-9b9a-4de8-9844-a293500bf217 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:14.046438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68e87d-9b9a-4de8-9844-a293500bf217 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:14.046438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68e87d-9b9a-4de8-9844-a293500bf217 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:14.059074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68e87d-9b9a-4de8-9844-a293500bf217 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:14.060915 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68e87d-9b9a-4de8-9844-a293500bf217 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-4a68e87d-9b9a-4de8-9844-a293500bf217 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:14.082508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:14.083501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:14.084488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:14.084488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:14.084488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:14.084488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:14.084488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:14.084488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:14.084488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:14.084488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:14.084488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:14.084488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:14.084488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 367/739] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 16 00:12:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:14.085075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68e87d-9b9a-4de8-9844-a293500bf217 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:14.095526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a3aaf-45f7-43d7-90f3-a839b0e0c10a None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:14.141770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81b82e-0b38-424e-9868-286c78c1b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:14.143219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81b82e-0b38-424e-9868-286c78c1b337 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:14.143699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81b82e-0b38-424e-9868-286c78c1b337 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:14.144456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81b82e-0b38-424e-9868-286c78c1b337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:14.158542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81b82e-0b38-424e-9868-286c78c1b337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:14.160857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81b82e-0b38-424e-9868-286c78c1b337 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-ad81b82e-0b38-424e-9868-286c78c1b337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:14.181079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:14.182018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:14.182889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:14.182889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:14.182889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:14.182889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:14.187011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 373/740] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:14.188893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7437-b523-4a1b-8e3e-9dce99e383cd None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:14.189008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:14.189089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7437-b523-4a1b-8e3e-9dce99e383cd None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:14.189089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7437-b523-4a1b-8e3e-9dce99e383cd None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:14.194750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 374/741] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:14.194750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc7437-b523-4a1b-8e3e-9dce99e383cd None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:14.223871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68e87d-9b9a-4de8-9844-a293500bf217 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:14.245528 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:14.265234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf01a6b-f590-4a62-ba3d-e9672cdf7dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:14.266002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf01a6b-f590-4a62-ba3d-e9672cdf7dbe None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:14.266274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf01a6b-f590-4a62-ba3d-e9672cdf7dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:14.266552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf01a6b-f590-4a62-ba3d-e9672cdf7dbe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:14.277353 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf01a6b-f590-4a62-ba3d-e9672cdf7dbe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:14.278806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf01a6b-f590-4a62-ba3d-e9672cdf7dbe None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-dbf01a6b-f590-4a62-ba3d-e9672cdf7dbe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:14.299105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:14.300670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:14.301593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:14.301593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:14.301593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:14.301593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:14.301593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:14.301593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:14.301593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:14.301593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:14.301593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:14.301593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:14.304125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 368/742] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 16 00:12:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:14.305175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf01a6b-f590-4a62-ba3d-e9672cdf7dbe None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:14.327335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc7437-b523-4a1b-8e3e-9dce99e383cd None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:14.370095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b61554-f76f-4d0a-92ad-734dba59ed8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:14.370933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61554-f76f-4d0a-92ad-734dba59ed8f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:14.371334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61554-f76f-4d0a-92ad-734dba59ed8f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:14.371736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b61554-f76f-4d0a-92ad-734dba59ed8f None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:14.372850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b61554-f76f-4d0a-92ad-734dba59ed8f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:14.373233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b61554-f76f-4d0a-92ad-734dba59ed8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:14.375060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b61554-f76f-4d0a-92ad-734dba59ed8f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:14.404167 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 375/743] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 16 00:12:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:14.406096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f35f-3d0e-4784-8d02-70f4547a4cf1 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:14.406392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f35f-3d0e-4784-8d02-70f4547a4cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:14.406670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f35f-3d0e-4784-8d02-70f4547a4cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:14.433402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf01a6b-f590-4a62-ba3d-e9672cdf7dbe None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:14.441830 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-b8c1f35f-3d0e-4784-8d02-70f4547a4cf1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:14.442655 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b8c1f35f-3d0e-4784-8d02-70f4547a4cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:14.481918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae635a1-4bbb-4ecb-bf4a-8082c182e651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:14.482650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae635a1-4bbb-4ecb-bf4a-8082c182e651 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:14.482939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae635a1-4bbb-4ecb-bf4a-8082c182e651 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:14.483280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae635a1-4bbb-4ecb-bf4a-8082c182e651 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:14.484049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae635a1-4bbb-4ecb-bf4a-8082c182e651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:14.484460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae635a1-4bbb-4ecb-bf4a-8082c182e651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:14.485848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae635a1-4bbb-4ecb-bf4a-8082c182e651 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:14.497061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:14.501100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 369/744] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:14.502180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae635a1-4bbb-4ecb-bf4a-8082c182e651 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:14.532200 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 376/745] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:14 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:14.532200 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1f35f-3d0e-4784-8d02-70f4547a4cf1 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:14.561294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:14.630502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae635a1-4bbb-4ecb-bf4a-8082c182e651 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:14.652364 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1f35f-3d0e-4784-8d02-70f4547a4cf1 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:14.676000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923346dc-8f68-4509-abb6-82e2753ab8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:14.676605 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923346dc-8f68-4509-abb6-82e2753ab8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:14.676892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923346dc-8f68-4509-abb6-82e2753ab8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:14.677173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923346dc-8f68-4509-abb6-82e2753ab8d8 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:14.678019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923346dc-8f68-4509-abb6-82e2753ab8d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:14.678332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923346dc-8f68-4509-abb6-82e2753ab8d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:14.679778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923346dc-8f68-4509-abb6-82e2753ab8d8 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:14.696109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf2d8b-807a-4e81-ac99-518fdb89ebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:14.697361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf2d8b-807a-4e81-ac99-518fdb89ebd0 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:14.697852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf2d8b-807a-4e81-ac99-518fdb89ebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:14.698341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf2d8b-807a-4e81-ac99-518fdb89ebd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:14.703214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 370/746] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 16 00:12:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:14.704150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923346dc-8f68-4509-abb6-82e2753ab8d8 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:14.772646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:14.785020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf2d8b-807a-4e81-ac99-518fdb89ebd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:14.787662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf2d8b-807a-4e81-ac99-518fdb89ebd0 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:14.821378 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:14.831535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923346dc-8f68-4509-abb6-82e2753ab8d8 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:14.879570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde09b4a-1212-4ee7-a899-695793f6a7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:14.880436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde09b4a-1212-4ee7-a899-695793f6a7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:14.880720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde09b4a-1212-4ee7-a899-695793f6a7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:14.880997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde09b4a-1212-4ee7-a899-695793f6a7c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:14.891074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde09b4a-1212-4ee7-a899-695793f6a7c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:14.892602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde09b4a-1212-4ee7-a899-695793f6a7c7 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-dde09b4a-1212-4ee7-a899-695793f6a7c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:14.908307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:14.909809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:14.910768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:14.910768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:14.910768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:14.910768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:14.910768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:14.910768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:14.910768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:14.910768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:14.910768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:12:14.910768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:14.910768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 371/747] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:14.911356 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde09b4a-1212-4ee7-a899-695793f6a7c7 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:14.936310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 377/748] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:14 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:14.936310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf2d8b-807a-4e81-ac99-518fdb89ebd0 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:15.049267 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde09b4a-1212-4ee7-a899-695793f6a7c7 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:15.065377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf2d8b-807a-4e81-ac99-518fdb89ebd0 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:15.069506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:15.091846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154df5b-fc1a-4a88-b1cb-95cd5863f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:15.092824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154df5b-fc1a-4a88-b1cb-95cd5863f157 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:15.093113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154df5b-fc1a-4a88-b1cb-95cd5863f157 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:15.093395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154df5b-fc1a-4a88-b1cb-95cd5863f157 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:15.094131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154df5b-fc1a-4a88-b1cb-95cd5863f157 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:15.095508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154df5b-fc1a-4a88-b1cb-95cd5863f157 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:15.097519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:15.110744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf98415-04e5-47b6-be93-b79e52a13859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:15.111550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf98415-04e5-47b6-be93-b79e52a13859 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:15.111836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf98415-04e5-47b6-be93-b79e52a13859 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:15.112662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf98415-04e5-47b6-be93-b79e52a13859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:15.113965 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 372/749] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:12:14 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:15.115041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154df5b-fc1a-4a88-b1cb-95cd5863f157 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:15.130291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf98415-04e5-47b6-be93-b79e52a13859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:15.132182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf98415-04e5-47b6-be93-b79e52a13859 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-5bf98415-04e5-47b6-be93-b79e52a13859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:15.162913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:15.163876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:15.169717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:15.169717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:15.169717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:15.169717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:15.169717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 378/750] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:15.169717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf98415-04e5-47b6-be93-b79e52a13859 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:15.297215 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154df5b-fc1a-4a88-b1cb-95cd5863f157 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:15.322225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf98415-04e5-47b6-be93-b79e52a13859 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:15.361625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80eabd-8538-4246-86f9-a9f3d10f1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:15.363279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80eabd-8538-4246-86f9-a9f3d10f1e0e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:15.363568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80eabd-8538-4246-86f9-a9f3d10f1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:15.363847 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80eabd-8538-4246-86f9-a9f3d10f1e0e None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:15.364918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80eabd-8538-4246-86f9-a9f3d10f1e0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:15.365238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80eabd-8538-4246-86f9-a9f3d10f1e0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:15.366700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80eabd-8538-4246-86f9-a9f3d10f1e0e None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:15.374892 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078e7dc-d3af-40f4-be56-8f72607c9a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:15.375698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e7dc-d3af-40f4-be56-8f72607c9a90 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:15.376028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e7dc-d3af-40f4-be56-8f72607c9a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:15.377048 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e7dc-d3af-40f4-be56-8f72607c9a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:15.395434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078e7dc-d3af-40f4-be56-8f72607c9a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:15.397532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078e7dc-d3af-40f4-be56-8f72607c9a90 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:15.410168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 373/751] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 16 00:12:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:15.410168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80eabd-8538-4246-86f9-a9f3d10f1e0e None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-9078e7dc-d3af-40f4-be56-8f72607c9a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:15.431365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:15.432369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:15.433263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:15.433263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:15.433263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:15.433263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:15.433263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 379/752] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:15.433263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078e7dc-d3af-40f4-be56-8f72607c9a90 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:15.472524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:15.495067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:15.606468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80eabd-8538-4246-86f9-a9f3d10f1e0e None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:15.631282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078e7dc-d3af-40f4-be56-8f72607c9a90 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:15.674227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162ca68-d2e8-49ab-bc7f-076a05fcb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:15.674964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162ca68-d2e8-49ab-bc7f-076a05fcb9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:15.675250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162ca68-d2e8-49ab-bc7f-076a05fcb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:15.675528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162ca68-d2e8-49ab-bc7f-076a05fcb9a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:15.676282 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162ca68-d2e8-49ab-bc7f-076a05fcb9a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:15.676593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162ca68-d2e8-49ab-bc7f-076a05fcb9a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:15.677978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162ca68-d2e8-49ab-bc7f-076a05fcb9a5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:15.695339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dfa44-efc4-4911-8120-677be0d169e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:15.704147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dfa44-efc4-4911-8120-677be0d169e4 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:15.704147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dfa44-efc4-4911-8120-677be0d169e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:15.704147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dfa44-efc4-4911-8120-677be0d169e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:15.704455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 374/753] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:15.704455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162ca68-d2e8-49ab-bc7f-076a05fcb9a5 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:15.830516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41dfa44-efc4-4911-8120-677be0d169e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:15.832575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41dfa44-efc4-4911-8120-677be0d169e4 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:15.880469 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:15.887987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:15.905332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162ca68-d2e8-49ab-bc7f-076a05fcb9a5 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:15.969924 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e031f2-e534-46e0-80c5-bb0086914c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:15.971021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e031f2-e534-46e0-80c5-bb0086914c61 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:15.974455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e031f2-e534-46e0-80c5-bb0086914c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:15.974984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e031f2-e534-46e0-80c5-bb0086914c61 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:15.975935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e031f2-e534-46e0-80c5-bb0086914c61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:15.976574 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e031f2-e534-46e0-80c5-bb0086914c61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:15.978149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e031f2-e534-46e0-80c5-bb0086914c61 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:15.980922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 380/754] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:12:15.981799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dfa44-efc4-4911-8120-677be0d169e4 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:16.001131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 375/755] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:16.002657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e031f2-e534-46e0-80c5-bb0086914c61 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:16.110084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dfa44-efc4-4911-8120-677be0d169e4 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:16.145989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:16.153315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e031f2-e534-46e0-80c5-bb0086914c61 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:16.157052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1571b-1f12-4cd4-a89f-1172bccd42e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:16.158029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1571b-1f12-4cd4-a89f-1172bccd42e3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:16.158464 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1571b-1f12-4cd4-a89f-1172bccd42e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:16.159419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1571b-1f12-4cd4-a89f-1172bccd42e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:16.171996 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1571b-1f12-4cd4-a89f-1172bccd42e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:16.174398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1571b-1f12-4cd4-a89f-1172bccd42e3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-ebc1571b-1f12-4cd4-a89f-1172bccd42e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:16.196312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:16.197477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:16.198563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:16.198563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:16.198563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:16.198563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:16.198563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:16.198563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:16.198563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:16.198563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:16.200317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d2f95-55a4-437f-b658-324ebd098529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:16.200990 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 381/756] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:16.201419 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d2f95-55a4-437f-b658-324ebd098529 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:16.201880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d2f95-55a4-437f-b658-324ebd098529 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:16.202258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d2f95-55a4-437f-b658-324ebd098529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:16.202369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1571b-1f12-4cd4-a89f-1172bccd42e3 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:16.218829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d2f95-55a4-437f-b658-324ebd098529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:16.220651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d2f95-55a4-437f-b658-324ebd098529 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-b99d2f95-55a4-437f-b658-324ebd098529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:16.240285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:16.241205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:16.242117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:16.242117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:16.242117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:16.242117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:16.244217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 376/757] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:16.245761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b2675-b94d-4249-9aac-6df1f520f4ce None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:16.246279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b2675-b94d-4249-9aac-6df1f520f4ce None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:16.246759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b2675-b94d-4249-9aac-6df1f520f4ce None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:16.248467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 377/758] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:16.249378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b2675-b94d-4249-9aac-6df1f520f4ce None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:16.252959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:16.339578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1571b-1f12-4cd4-a89f-1172bccd42e3 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:16.379253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b2675-b94d-4249-9aac-6df1f520f4ce None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:16.384786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ffdbc-023f-488a-9b0b-2a857c916983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:16.385596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ffdbc-023f-488a-9b0b-2a857c916983 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:16.385878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ffdbc-023f-488a-9b0b-2a857c916983 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:16.386155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ffdbc-023f-488a-9b0b-2a857c916983 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:16.395503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ffdbc-023f-488a-9b0b-2a857c916983 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:16.397194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ffdbc-023f-488a-9b0b-2a857c916983 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-b08ffdbc-023f-488a-9b0b-2a857c916983 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:16.415289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:16.416398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:16.417312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:16.417312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:16.417312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:16.417312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:16.417312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:16.417312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:16.417312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:16.417312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:16.421601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 382/759] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:16.422480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ffdbc-023f-488a-9b0b-2a857c916983 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:16.423838 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c63662-5da0-484c-8de6-fe502d7675ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:16.424882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63662-5da0-484c-8de6-fe502d7675ca None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:16.425269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63662-5da0-484c-8de6-fe502d7675ca None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:16.425815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63662-5da0-484c-8de6-fe502d7675ca None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:16.427610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c63662-5da0-484c-8de6-fe502d7675ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:16.429739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c63662-5da0-484c-8de6-fe502d7675ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:16.431217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c63662-5da0-484c-8de6-fe502d7675ca None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:16.452188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 378/760] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:16.453958 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79902d28-269c-438f-943f-befbc13befa4 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:16.454456 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79902d28-269c-438f-943f-befbc13befa4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:16.454937 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79902d28-269c-438f-943f-befbc13befa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:16.474293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-79902d28-269c-438f-943f-befbc13befa4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:16.475829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-79902d28-269c-438f-943f-befbc13befa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:16.481276 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:16.542475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:16.545372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ffdbc-023f-488a-9b0b-2a857c916983 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:16.555999 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 379/761] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:16.557170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79902d28-269c-438f-943f-befbc13befa4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:16.597270 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541ee2a-6d0b-46f5-91fb-bac3b0f26084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:16.598277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541ee2a-6d0b-46f5-91fb-bac3b0f26084 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:16.599178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541ee2a-6d0b-46f5-91fb-bac3b0f26084 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:16.600479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541ee2a-6d0b-46f5-91fb-bac3b0f26084 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:16.601460 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541ee2a-6d0b-46f5-91fb-bac3b0f26084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:16.601971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541ee2a-6d0b-46f5-91fb-bac3b0f26084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:16.603639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541ee2a-6d0b-46f5-91fb-bac3b0f26084 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:16.619478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 383/762] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:16.620839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541ee2a-6d0b-46f5-91fb-bac3b0f26084 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:16.693444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79902d28-269c-438f-943f-befbc13befa4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:16.737424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a01464-63ff-44b1-925b-511ef0e1bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:16.738259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a01464-63ff-44b1-925b-511ef0e1bc3e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:16.738759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a01464-63ff-44b1-925b-511ef0e1bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:16.739143 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a01464-63ff-44b1-925b-511ef0e1bc3e None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:16.740101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a01464-63ff-44b1-925b-511ef0e1bc3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:16.740521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a01464-63ff-44b1-925b-511ef0e1bc3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:16.742061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a01464-63ff-44b1-925b-511ef0e1bc3e None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:16.746578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541ee2a-6d0b-46f5-91fb-bac3b0f26084 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:16.759628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 380/763] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:16.759628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a01464-63ff-44b1-925b-511ef0e1bc3e None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:16.761924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:16.798419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cf857-c671-4d1a-8900-f8c77423cc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:16.800063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cf857-c671-4d1a-8900-f8c77423cc91 None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:16.800418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cf857-c671-4d1a-8900-f8c77423cc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:16.800899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cf857-c671-4d1a-8900-f8c77423cc91 None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/cd57046b084b463488296b825097081d/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:16.803157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cf857-c671-4d1a-8900-f8c77423cc91 None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=cd57046b084b463488296b825097081d, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:16.804668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cf857-c671-4d1a-8900-f8c77423cc91 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:16.832008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 384/764] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:12:16 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/cd57046b084b463488296b825097081d/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:12:16.832008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cf857-c671-4d1a-8900-f8c77423cc91 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:16.832316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:16.891623 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a01464-63ff-44b1-925b-511ef0e1bc3e None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:16.976072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4838a8-93c5-4b5c-a61b-532819938221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:16.976072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4838a8-93c5-4b5c-a61b-532819938221 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:16.976072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4838a8-93c5-4b5c-a61b-532819938221 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:16.976072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4838a8-93c5-4b5c-a61b-532819938221 None admin] PATH_INFO: `/v3/services/network` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:16.976470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4838a8-93c5-4b5c-a61b-532819938221 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:16.978661 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4838a8-93c5-4b5c-a61b-532819938221 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-3c4838a8-93c5-4b5c-a61b-532819938221 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:16.999163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:17.000259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:12:17.001271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:17.012271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 381/765] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:16 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:17.013175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4838a8-93c5-4b5c-a61b-532819938221 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:17.027797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cf857-c671-4d1a-8900-f8c77423cc91 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:17.096718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f027ad9-7339-495d-bd16-62e23ee6a263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:17.097943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f027ad9-7339-495d-bd16-62e23ee6a263 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:17.099955 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f027ad9-7339-495d-bd16-62e23ee6a263 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:17.100508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f027ad9-7339-495d-bd16-62e23ee6a263 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:17.119353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f027ad9-7339-495d-bd16-62e23ee6a263 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:17.121299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f027ad9-7339-495d-bd16-62e23ee6a263 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-2f027ad9-7339-495d-bd16-62e23ee6a263 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:17.151131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:17.152083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:17.152974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:17.152974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:17.152974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:17.152974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:17.152974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:17.152974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:17.152974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:17.152974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:17.158720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 385/766] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:17.159617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f027ad9-7339-495d-bd16-62e23ee6a263 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:17.186781 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4838a8-93c5-4b5c-a61b-532819938221 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:17.205382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:17.206619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:17.238213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe6579-9ab6-4eea-b21f-844250fd1266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:17.239231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6579-9ab6-4eea-b21f-844250fd1266 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:17.240787 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6579-9ab6-4eea-b21f-844250fd1266 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:17.241274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe6579-9ab6-4eea-b21f-844250fd1266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:17.243375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe6579-9ab6-4eea-b21f-844250fd1266 None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=1fc6d76795694d91b41b8bf819728aae) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:17.244109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe6579-9ab6-4eea-b21f-844250fd1266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:17.246084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe6579-9ab6-4eea-b21f-844250fd1266 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:17.262501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 382/767] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:17 2022] GET /identity/v3/role_assignments?user.id=1fc6d76795694d91b41b8bf819728aae&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:17.263892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe6579-9ab6-4eea-b21f-844250fd1266 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:17.298454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f027ad9-7339-495d-bd16-62e23ee6a263 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:17.379878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3721-b816-49ea-9ebc-7bb1e6404b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:17.380616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3721-b816-49ea-9ebc-7bb1e6404b0c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:17.381044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3721-b816-49ea-9ebc-7bb1e6404b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:17.381327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3721-b816-49ea-9ebc-7bb1e6404b0c None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:17.382055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f3721-b816-49ea-9ebc-7bb1e6404b0c None admin] RBAC: Adding query filter params (name=network) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:17.382485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f3721-b816-49ea-9ebc-7bb1e6404b0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:17.383745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f3721-b816-49ea-9ebc-7bb1e6404b0c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:17.399800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 386/768] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:17.404035 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3721-b816-49ea-9ebc-7bb1e6404b0c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:17.499922 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe6579-9ab6-4eea-b21f-844250fd1266 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:17.548743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588ba55-bfd9-4b00-bc61-5035addb45f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:17.550408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588ba55-bfd9-4b00-bc61-5035addb45f0 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:17.551161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588ba55-bfd9-4b00-bc61-5035addb45f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:17.551748 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588ba55-bfd9-4b00-bc61-5035addb45f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:17.552792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588ba55-bfd9-4b00-bc61-5035addb45f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:17.553282 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588ba55-bfd9-4b00-bc61-5035addb45f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:17.554899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588ba55-bfd9-4b00-bc61-5035addb45f0 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:17.588651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 383/769] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:17.591134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b98984-255e-4aed-a875-85bbbe94ae25 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:17.591661 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b98984-255e-4aed-a875-85bbbe94ae25 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:17.592161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b98984-255e-4aed-a875-85bbbe94ae25 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:17.597702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 384/770] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:17.598657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b98984-255e-4aed-a875-85bbbe94ae25 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:17.619110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:17.633120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3721-b816-49ea-9ebc-7bb1e6404b0c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:17.688825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:17.704982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5cdd0-3dee-41f2-85b0-2f80c1bb9afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:17.705799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5cdd0-3dee-41f2-85b0-2f80c1bb9afc None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:17.706071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5cdd0-3dee-41f2-85b0-2f80c1bb9afc None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:17.706348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5cdd0-3dee-41f2-85b0-2f80c1bb9afc None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:17.707065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5cdd0-3dee-41f2-85b0-2f80c1bb9afc None admin] RBAC: Adding query filter params (type=network) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:17.707375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5cdd0-3dee-41f2-85b0-2f80c1bb9afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:17.708780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5cdd0-3dee-41f2-85b0-2f80c1bb9afc None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:17.727886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 387/771] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:17.730389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a50909-b4ff-412a-9108-1ecd60f67c02 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:17.730907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a50909-b4ff-412a-9108-1ecd60f67c02 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:17.732172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a50909-b4ff-412a-9108-1ecd60f67c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:17.765642 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-15a50909-b4ff-412a-9108-1ecd60f67c02 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:17.768780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-15a50909-b4ff-412a-9108-1ecd60f67c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:17.809621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b98984-255e-4aed-a875-85bbbe94ae25 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:17.880522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4891ec-9fcb-4961-9357-a92894eafc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:17.881464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4891ec-9fcb-4961-9357-a92894eafc02 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:17.881892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4891ec-9fcb-4961-9357-a92894eafc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:17.882361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4891ec-9fcb-4961-9357-a92894eafc02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:17.883397 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4891ec-9fcb-4961-9357-a92894eafc02 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=88d67d41124c4deda1c5ecdab82d3055) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:17.883877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4891ec-9fcb-4961-9357-a92894eafc02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:17.885653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4891ec-9fcb-4961-9357-a92894eafc02 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:17.899208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 385/772] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:17 2022] GET /identity/v3/role_assignments?user.id=88d67d41124c4deda1c5ecdab82d3055&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:17.902330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4891ec-9fcb-4961-9357-a92894eafc02 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:17.912729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 388/773] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:17.953293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a50909-b4ff-412a-9108-1ecd60f67c02 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:18.084323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4891ec-9fcb-4961-9357-a92894eafc02 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:18.087434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:18.137244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:18.158471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f106c-4b2f-4f56-a4e2-3b25d3457448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:18.159606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f106c-4b2f-4f56-a4e2-3b25d3457448 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:18.160141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f106c-4b2f-4f56-a4e2-3b25d3457448 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:18.160821 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f106c-4b2f-4f56-a4e2-3b25d3457448 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:18.161845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f106c-4b2f-4f56-a4e2-3b25d3457448 None admin] RBAC: Adding query filter params (interface=public, service_id=bcc1d2242cf048dfad56f965b42156cf, region_id=RegionOne) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:18.162383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f106c-4b2f-4f56-a4e2-3b25d3457448 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:18.164061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f106c-4b2f-4f56-a4e2-3b25d3457448 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:18.184703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a50909-b4ff-412a-9108-1ecd60f67c02 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:18.186768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 386/774] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 16 00:12:17 2022] GET /identity/v3/endpoints?service_id=bcc1d2242cf048dfad56f965b42156cf&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:18.189200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f106c-4b2f-4f56-a4e2-3b25d3457448 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:18.241524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541fc51-ebfa-45de-b586-b96185a1294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:18.241524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541fc51-ebfa-45de-b586-b96185a1294b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:18.241524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541fc51-ebfa-45de-b586-b96185a1294b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:18.241524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541fc51-ebfa-45de-b586-b96185a1294b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:18.242247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541fc51-ebfa-45de-b586-b96185a1294b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:18.243480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541fc51-ebfa-45de-b586-b96185a1294b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-a541fc51-ebfa-45de-b586-b96185a1294b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:18.267221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:18.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:18.273894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 389/775] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Jun 16 00:12:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:18.277025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541fc51-ebfa-45de-b586-b96185a1294b None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:18.397383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f106c-4b2f-4f56-a4e2-3b25d3457448 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:18.451910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9f305-cace-4c80-aadb-f98299112185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:18.452666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f305-cace-4c80-aadb-f98299112185 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:18.452952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f305-cace-4c80-aadb-f98299112185 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:18.453232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f305-cace-4c80-aadb-f98299112185 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:18.453921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9f305-cace-4c80-aadb-f98299112185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:18.455634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9f305-cace-4c80-aadb-f98299112185 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:18.461367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 387/776] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 16 00:12:18 2022] GET /identity/v3/services => generated 772 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:18.621161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541fc51-ebfa-45de-b586-b96185a1294b None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:18.684390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb906966-6e6b-4cb7-8ca1-200414d2ab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:18.685084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb906966-6e6b-4cb7-8ca1-200414d2ab77 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:18.685372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb906966-6e6b-4cb7-8ca1-200414d2ab77 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:18.685655 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb906966-6e6b-4cb7-8ca1-200414d2ab77 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:18.686387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb906966-6e6b-4cb7-8ca1-200414d2ab77 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:18.686701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb906966-6e6b-4cb7-8ca1-200414d2ab77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:18.696306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb906966-6e6b-4cb7-8ca1-200414d2ab77 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:18.702250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 390/777] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 16 00:12:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:18.711789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9f305-cace-4c80-aadb-f98299112185 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:18.781693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:18.873763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9f305-cace-4c80-aadb-f98299112185 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:18.930125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d37ac-ba25-475f-962f-fced04448d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:18.930803 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d37ac-ba25-475f-962f-fced04448d46 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:18.931089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d37ac-ba25-475f-962f-fced04448d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:18.931365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d37ac-ba25-475f-962f-fced04448d46 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:18.932116 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d37ac-ba25-475f-962f-fced04448d46 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:18.932428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d37ac-ba25-475f-962f-fced04448d46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:18.933802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d37ac-ba25-475f-962f-fced04448d46 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:18.939223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 388/778] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 16 00:12:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:18.945052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb906966-6e6b-4cb7-8ca1-200414d2ab77 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:19.008042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:19.170579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb906966-6e6b-4cb7-8ca1-200414d2ab77 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:19.227946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c30f9-e41e-447a-8892-8a0e1bbde7b1 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:19.228272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c30f9-e41e-447a-8892-8a0e1bbde7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:19.228532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c30f9-e41e-447a-8892-8a0e1bbde7b1 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:19.230027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 389/779] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:19.237488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3972-bdbd-412e-b7b7-ad059fb71375 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:19.237778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3972-bdbd-412e-b7b7-ad059fb71375 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:19.238058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd3972-bdbd-412e-b7b7-ad059fb71375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:19.261572 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e31e9-18ce-4af3-a46f-f8d31c628a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:19.262254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e31e9-18ce-4af3-a46f-f8d31c628a06 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:19.262539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e31e9-18ce-4af3-a46f-f8d31c628a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:19.262816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e31e9-18ce-4af3-a46f-f8d31c628a06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:19.263611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e31e9-18ce-4af3-a46f-f8d31c628a06 None admin] RBAC: Adding query filter params (interface=public, service_id=d2b07cc0847f41a69dc424412bf0f1af, region_id=RegionOne) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:19.263924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e31e9-18ce-4af3-a46f-f8d31c628a06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:19.265318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e31e9-18ce-4af3-a46f-f8d31c628a06 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:19.280255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 391/780] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 16 00:12:18 2022] GET /identity/v3/endpoints?service_id=d2b07cc0847f41a69dc424412bf0f1af&interface=public®ion_id=RegionOne => generated 194 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:19.281576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-85bd3972-bdbd-412e-b7b7-ad059fb71375 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:19.282999 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-85bd3972-bdbd-412e-b7b7-ad059fb71375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:19.283109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e31e9-18ce-4af3-a46f-f8d31c628a06 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:19.398621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:19.422363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e31e9-18ce-4af3-a46f-f8d31c628a06 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:19.469635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ff1a1-cf0c-4d86-9f62-dfbd514f6ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:19.470323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ff1a1-cf0c-4d86-9f62-dfbd514f6ede None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:19.470609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ff1a1-cf0c-4d86-9f62-dfbd514f6ede None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:19.470889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ff1a1-cf0c-4d86-9f62-dfbd514f6ede None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:19.472180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ff1a1-cf0c-4d86-9f62-dfbd514f6ede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:19.479995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ff1a1-cf0c-4d86-9f62-dfbd514f6ede None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:19.479995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 392/781] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 16 00:12:19 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:19.496856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 390/782] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:19.536872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ff1a1-cf0c-4d86-9f62-dfbd514f6ede None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:19.733603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ff1a1-cf0c-4d86-9f62-dfbd514f6ede None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:19.785604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3122a6-0b8f-4b91-b6c0-2844198b337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:19.786967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3122a6-0b8f-4b91-b6c0-2844198b337e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:19.787478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3122a6-0b8f-4b91-b6c0-2844198b337e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:19.787957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3122a6-0b8f-4b91-b6c0-2844198b337e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:19.808370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3122a6-0b8f-4b91-b6c0-2844198b337e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-6b3122a6-0b8f-4b91-b6c0-2844198b337e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:19.816680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:19.817606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:19.818443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:19.821163 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 393/783] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:19.827238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd3972-bdbd-412e-b7b7-ad059fb71375 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:19.861134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:19.943583 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd3972-bdbd-412e-b7b7-ad059fb71375 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:19.951066 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0a758-cc68-45ca-b0f3-4cb38b717b77 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:19.951652 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0a758-cc68-45ca-b0f3-4cb38b717b77 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:19.952162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0a758-cc68-45ca-b0f3-4cb38b717b77 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:19.953977 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 394/784] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:19.959300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfdbf-b361-4241-8036-60a33e59f9a6 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:19.959538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfdbf-b361-4241-8036-60a33e59f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:19.959782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfdbf-b361-4241-8036-60a33e59f9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:19.980598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:19.994918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e49a28-6fab-437e-a6e2-ff1b5b0924bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:19.999117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e49a28-6fab-437e-a6e2-ff1b5b0924bb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:19.999658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e49a28-6fab-437e-a6e2-ff1b5b0924bb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:20.000253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e49a28-6fab-437e-a6e2-ff1b5b0924bb None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:20.004890 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e49a28-6fab-437e-a6e2-ff1b5b0924bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:20.005619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e49a28-6fab-437e-a6e2-ff1b5b0924bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:20.009924 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e49a28-6fab-437e-a6e2-ff1b5b0924bb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:20.013214 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-6d1bfdbf-b361-4241-8036-60a33e59f9a6 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:20.014829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6d1bfdbf-b361-4241-8036-60a33e59f9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:20.034467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 391/785] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:20.041042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e49a28-6fab-437e-a6e2-ff1b5b0924bb None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:20.177643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 395/786] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:20.203497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e49a28-6fab-437e-a6e2-ff1b5b0924bb None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:20.221565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bfdbf-b361-4241-8036-60a33e59f9a6 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:20.244479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:20.259010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f30863-5aba-434a-a938-c8c71c4702f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:20.260178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f30863-5aba-434a-a938-c8c71c4702f5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:20.260668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f30863-5aba-434a-a938-c8c71c4702f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:20.261156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f30863-5aba-434a-a938-c8c71c4702f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:20.277670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f30863-5aba-434a-a938-c8c71c4702f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:20.279713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f30863-5aba-434a-a938-c8c71c4702f5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-23f30863-5aba-434a-a938-c8c71c4702f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:20.319820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:20.320813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:20.321716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:20.321716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:20.321716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:20.321716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:20.324448 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 392/787] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:20.333167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f30863-5aba-434a-a938-c8c71c4702f5 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:20.488093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f30863-5aba-434a-a938-c8c71c4702f5 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:20.534030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bfdbf-b361-4241-8036-60a33e59f9a6 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:20.541953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4b4e8-2661-4a34-9e42-e6937a49e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:20.542940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4b4e8-2661-4a34-9e42-e6937a49e56e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:20.543452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4b4e8-2661-4a34-9e42-e6937a49e56e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:20.543947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4b4e8-2661-4a34-9e42-e6937a49e56e None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:20.545480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4b4e8-2661-4a34-9e42-e6937a49e56e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:20.545999 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4b4e8-2661-4a34-9e42-e6937a49e56e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:20.547582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4b4e8-2661-4a34-9e42-e6937a49e56e None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:20.564348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:20.574183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 393/788] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:20.579899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4b4e8-2661-4a34-9e42-e6937a49e56e None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:20.644734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:20.682917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aeef2f-d888-4a61-9ee2-ce36d5476b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:20.683763 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeef2f-d888-4a61-9ee2-ce36d5476b9e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:20.684102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeef2f-d888-4a61-9ee2-ce36d5476b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:20.684565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aeef2f-d888-4a61-9ee2-ce36d5476b9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:20.732629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aeef2f-d888-4a61-9ee2-ce36d5476b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-67aeef2f-d888-4a61-9ee2-ce36d5476b9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:20.749126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:20.750551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:20.751379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 396/789] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:12:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 530 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:20.769641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29209-244d-4c50-b76a-03c6fb957e5a None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:20.769951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29209-244d-4c50-b76a-03c6fb957e5a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:20.770218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f29209-244d-4c50-b76a-03c6fb957e5a None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:20.771706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 397/790] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:20.772440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f29209-244d-4c50-b76a-03c6fb957e5a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:20.789440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4b4e8-2661-4a34-9e42-e6937a49e56e None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:20.842479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47744f2e-d9b0-4e39-8892-b04870ce9a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:20.846620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744f2e-d9b0-4e39-8892-b04870ce9a58 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:20.849322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744f2e-d9b0-4e39-8892-b04870ce9a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:20.852017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47744f2e-d9b0-4e39-8892-b04870ce9a58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:20.876184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47744f2e-d9b0-4e39-8892-b04870ce9a58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:20.880983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47744f2e-d9b0-4e39-8892-b04870ce9a58 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:20.915783 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f29209-244d-4c50-b76a-03c6fb957e5a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-47744f2e-d9b0-4e39-8892-b04870ce9a58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:20.922309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:20.923269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:20.924322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:20.924322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:20.924322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:20.924322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:20.924322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:20.924322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:20.924322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:20.924322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:20.924322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:20.924322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:20.934750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 394/791] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 16 00:12:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:20.936693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a06db9-84c7-4346-ae17-7021bcd725ff None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:20.937193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a06db9-84c7-4346-ae17-7021bcd725ff None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:20.937936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a06db9-84c7-4346-ae17-7021bcd725ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:20.963552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c4a06db9-84c7-4346-ae17-7021bcd725ff None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:20.965306 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c4a06db9-84c7-4346-ae17-7021bcd725ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:20.988478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202a3cd-f86e-4312-8af8-bbf6b9c3f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:20.989025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202a3cd-f86e-4312-8af8-bbf6b9c3f9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:20.989321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202a3cd-f86e-4312-8af8-bbf6b9c3f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:20.989604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202a3cd-f86e-4312-8af8-bbf6b9c3f9c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:20.990360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202a3cd-f86e-4312-8af8-bbf6b9c3f9c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:20.990674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202a3cd-f86e-4312-8af8-bbf6b9c3f9c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:20.992111 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202a3cd-f86e-4312-8af8-bbf6b9c3f9c1 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:21.007500 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 398/792] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:12:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:21.009193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202a3cd-f86e-4312-8af8-bbf6b9c3f9c1 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:21.066374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:21.080895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 395/793] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:21.082002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a06db9-84c7-4346-ae17-7021bcd725ff None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:21.115608 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:21.210035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a06db9-84c7-4346-ae17-7021bcd725ff None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:21.216864 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202a3cd-f86e-4312-8af8-bbf6b9c3f9c1 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:21.262101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be67c-454f-49d6-b2d3-253cc867735f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:21.263532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be67c-454f-49d6-b2d3-253cc867735f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:21.264264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be67c-454f-49d6-b2d3-253cc867735f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:21.265767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be67c-454f-49d6-b2d3-253cc867735f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:21.284977 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378be67c-454f-49d6-b2d3-253cc867735f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:21.286995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378be67c-454f-49d6-b2d3-253cc867735f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:21.290837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d107f-3022-4e14-8dcb-5b239030dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:21.291523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d107f-3022-4e14-8dcb-5b239030dd9b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:21.291815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d107f-3022-4e14-8dcb-5b239030dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:21.294209 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d107f-3022-4e14-8dcb-5b239030dd9b None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:21.295077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d107f-3022-4e14-8dcb-5b239030dd9b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:21.295400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d107f-3022-4e14-8dcb-5b239030dd9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:21.299625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d107f-3022-4e14-8dcb-5b239030dd9b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-378be67c-454f-49d6-b2d3-253cc867735f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:21.320707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:21.321602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:21.322522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:21.322522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:21.322522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:21.322522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:21.328873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 396/794] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:21.328873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be67c-454f-49d6-b2d3-253cc867735f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:21.341137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 399/795] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 16 00:12:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:21.342225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1ffd-0158-4033-b6d9-8721d7ca081c None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:21.342512 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1ffd-0158-4033-b6d9-8721d7ca081c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:21.342785 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1ffd-0158-4033-b6d9-8721d7ca081c None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:21.344176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 400/796] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:21.348191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1ffd-0158-4033-b6d9-8721d7ca081c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:21.387060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:21.467498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be67c-454f-49d6-b2d3-253cc867735f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:21.488884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1ffd-0158-4033-b6d9-8721d7ca081c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:21.505097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:21.536254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d848c8-87f0-4d21-99dd-f94c64480d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:21.537346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d848c8-87f0-4d21-99dd-f94c64480d3e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:21.537835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d848c8-87f0-4d21-99dd-f94c64480d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:21.538322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d848c8-87f0-4d21-99dd-f94c64480d3e None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:21.539343 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d848c8-87f0-4d21-99dd-f94c64480d3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:21.540252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d848c8-87f0-4d21-99dd-f94c64480d3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:21.541995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d848c8-87f0-4d21-99dd-f94c64480d3e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:21.565572 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 401/797] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:21.565764 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d848c8-87f0-4d21-99dd-f94c64480d3e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:21.638052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5ece1-3ea6-418f-9bd8-68a087b0e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:21.638948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ece1-3ea6-418f-9bd8-68a087b0e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:21.639237 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ece1-3ea6-418f-9bd8-68a087b0e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:21.639511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5ece1-3ea6-418f-9bd8-68a087b0e5f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:21.654780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5ece1-3ea6-418f-9bd8-68a087b0e5f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-fdd5ece1-3ea6-418f-9bd8-68a087b0e5f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:21.664089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:21.665047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:21.665904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 397/798] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:21.667160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b580e-87fe-4f88-8e28-91fe02e08c33 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:21.667160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b580e-87fe-4f88-8e28-91fe02e08c33 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:21.667426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b580e-87fe-4f88-8e28-91fe02e08c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:21.686893 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-df9b580e-87fe-4f88-8e28-91fe02e08c33 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:21.691453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-df9b580e-87fe-4f88-8e28-91fe02e08c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:21.710522 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d848c8-87f0-4d21-99dd-f94c64480d3e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:21.752910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d22a14-2801-4dab-a851-29752a9996d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:21.753663 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d22a14-2801-4dab-a851-29752a9996d5 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:21.753852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d22a14-2801-4dab-a851-29752a9996d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:21.754137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d22a14-2801-4dab-a851-29752a9996d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:21.776103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 398/799] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:21.777765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b580e-87fe-4f88-8e28-91fe02e08c33 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:21.829959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:21.832511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:21.883083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d22a14-2801-4dab-a851-29752a9996d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:21.884575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d22a14-2801-4dab-a851-29752a9996d5 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:21.961078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b580e-87fe-4f88-8e28-91fe02e08c33 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:22.003345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34abaff-cb16-4aec-ae6d-0ecce7848c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:22.004473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34abaff-cb16-4aec-ae6d-0ecce7848c65 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.005139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34abaff-cb16-4aec-ae6d-0ecce7848c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.005442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34abaff-cb16-4aec-ae6d-0ecce7848c65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.017554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34abaff-cb16-4aec-ae6d-0ecce7848c65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:22.022132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34abaff-cb16-4aec-ae6d-0ecce7848c65 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-d34abaff-cb16-4aec-ae6d-0ecce7848c65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:22.040474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:22.041558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:22.042562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:22.042562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:22.042562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:22.042562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:22.042562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:22.042562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:22.042562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:22.042562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:22.042562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:22.042562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:22.044117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 399/800] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 16 00:12:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:22.045168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34abaff-cb16-4aec-ae6d-0ecce7848c65 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:22.047186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 402/801] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:12:22.048126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d22a14-2801-4dab-a851-29752a9996d5 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:22.172130 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:22.202982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:22.211596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d22a14-2801-4dab-a851-29752a9996d5 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:22.213642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34abaff-cb16-4aec-ae6d-0ecce7848c65 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:22.248385 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4826440-c049-4b8b-b530-721430111c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:22.248601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc03dca-38af-45ec-9d0f-ef3c3452e6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:22.249147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc03dca-38af-45ec-9d0f-ef3c3452e6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.249455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc03dca-38af-45ec-9d0f-ef3c3452e6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.249563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4826440-c049-4b8b-b530-721430111c66 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.249712 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc03dca-38af-45ec-9d0f-ef3c3452e6e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.249927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4826440-c049-4b8b-b530-721430111c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.250276 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4826440-c049-4b8b-b530-721430111c66 None admin] PATH_INFO: `/v3/services/network` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.250451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc03dca-38af-45ec-9d0f-ef3c3452e6e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:22.250776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc03dca-38af-45ec-9d0f-ef3c3452e6e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:22.251109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4826440-c049-4b8b-b530-721430111c66 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:22.252198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc03dca-38af-45ec-9d0f-ef3c3452e6e1 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:22.252693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4826440-c049-4b8b-b530-721430111c66 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:22.260923 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 400/802] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:22.264160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc03dca-38af-45ec-9d0f-ef3c3452e6e1 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-e4826440-c049-4b8b-b530-721430111c66 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:22.264507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:22.265479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:22.266336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 403/803] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:22 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:22.267165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4826440-c049-4b8b-b530-721430111c66 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:22.367057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc03dca-38af-45ec-9d0f-ef3c3452e6e1 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:22.370925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4826440-c049-4b8b-b530-721430111c66 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:22.401247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb39521-c473-46b7-b1e8-114a47e82062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:22.401892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb39521-c473-46b7-b1e8-114a47e82062 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.402189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb39521-c473-46b7-b1e8-114a47e82062 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.402475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb39521-c473-46b7-b1e8-114a47e82062 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.403513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb39521-c473-46b7-b1e8-114a47e82062 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:22.403837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb39521-c473-46b7-b1e8-114a47e82062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:22.405296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb39521-c473-46b7-b1e8-114a47e82062 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:22.405427 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847fbe6-0992-445b-8952-b023e79cb1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:22.406161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847fbe6-0992-445b-8952-b023e79cb1ac None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.406450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847fbe6-0992-445b-8952-b023e79cb1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.406882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847fbe6-0992-445b-8952-b023e79cb1ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.410421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:22.423866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 401/804] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 16 00:12:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:22.424052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847fbe6-0992-445b-8952-b023e79cb1ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:22.425104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd90c-5c03-4298-bbe5-d0b648aa0a31 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.425400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd90c-5c03-4298-bbe5-d0b648aa0a31 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.425484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847fbe6-0992-445b-8952-b023e79cb1ac None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:22.425682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cd90c-5c03-4298-bbe5-d0b648aa0a31 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.427028 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 402/805] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:22.427609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cd90c-5c03-4298-bbe5-d0b648aa0a31 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:22.442854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-f847fbe6-0992-445b-8952-b023e79cb1ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:22.447784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:22.448842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:22.449755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:22.449755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:22.449755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:22.449755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:22.449755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 404/806] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:22.449755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847fbe6-0992-445b-8952-b023e79cb1ac None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:22.543208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cd90c-5c03-4298-bbe5-d0b648aa0a31 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:22.569235 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847fbe6-0992-445b-8952-b023e79cb1ac None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:22.576972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf9678-84aa-4a7c-bee5-0c089233964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:22.577772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9678-84aa-4a7c-bee5-0c089233964b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.578057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9678-84aa-4a7c-bee5-0c089233964b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.578341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9678-84aa-4a7c-bee5-0c089233964b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.591857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf9678-84aa-4a7c-bee5-0c089233964b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:22.593701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf9678-84aa-4a7c-bee5-0c089233964b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:22.604564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63ca25-1897-4850-be23-94ab6103310e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:22.605220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63ca25-1897-4850-be23-94ab6103310e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.605503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63ca25-1897-4850-be23-94ab6103310e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.605791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63ca25-1897-4850-be23-94ab6103310e None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.606492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63ca25-1897-4850-be23-94ab6103310e None admin] RBAC: Adding query filter params (name=network) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:22.606799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63ca25-1897-4850-be23-94ab6103310e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:22.608182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63ca25-1897-4850-be23-94ab6103310e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-dfcf9678-84aa-4a7c-bee5-0c089233964b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:22.611614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:22.612573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:22.613596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:22.613596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:22.613596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:22.613596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:22.613859 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 405/807] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:22.613939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 403/808] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:22.614430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4d59-d102-465a-8828-606079d458f9 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.614708 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4d59-d102-465a-8828-606079d458f9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.614985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4d59-d102-465a-8828-606079d458f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.616816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63ca25-1897-4850-be23-94ab6103310e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:22.631686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6c4f4d59-d102-465a-8828-606079d458f9 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:22.633137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6c4f4d59-d102-465a-8828-606079d458f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:22.679395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:22.695761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:22.707977 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 404/809] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:22.708956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f4d59-d102-465a-8828-606079d458f9 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:22.736511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63ca25-1897-4850-be23-94ab6103310e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:22.769624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5662180-d930-41b3-99be-757201f040d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:22.770490 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5662180-d930-41b3-99be-757201f040d7 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.770776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5662180-d930-41b3-99be-757201f040d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.771048 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5662180-d930-41b3-99be-757201f040d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.781341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5662180-d930-41b3-99be-757201f040d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:22.782796 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5662180-d930-41b3-99be-757201f040d7 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-a5662180-d930-41b3-99be-757201f040d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:22.800542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:22.801605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:22.802780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:22.802780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:22.802780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:22.802780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:22.802780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 406/810] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:22.802780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5662180-d930-41b3-99be-757201f040d7 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:22.813774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f4d59-d102-465a-8828-606079d458f9 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:22.847856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fe1c3-e44f-4840-a6be-9f281caa4018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:22.848546 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fe1c3-e44f-4840-a6be-9f281caa4018 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.848839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fe1c3-e44f-4840-a6be-9f281caa4018 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.849120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fe1c3-e44f-4840-a6be-9f281caa4018 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.849842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fe1c3-e44f-4840-a6be-9f281caa4018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:22.850150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fe1c3-e44f-4840-a6be-9f281caa4018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:22.851516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fe1c3-e44f-4840-a6be-9f281caa4018 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:22.862549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 405/811] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:22.866978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fe1c3-e44f-4840-a6be-9f281caa4018 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:22.901396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5662180-d930-41b3-99be-757201f040d7 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:22.903618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:22.917991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:22.935306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aba72-1cd4-43dd-be71-e3bfc7b641f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:22.935995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aba72-1cd4-43dd-be71-e3bfc7b641f5 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.936291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aba72-1cd4-43dd-be71-e3bfc7b641f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.936571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aba72-1cd4-43dd-be71-e3bfc7b641f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.937288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aba72-1cd4-43dd-be71-e3bfc7b641f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:22.937599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aba72-1cd4-43dd-be71-e3bfc7b641f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:22.938969 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287aba72-1cd4-43dd-be71-e3bfc7b641f5 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:22.950507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 407/812] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:22.951279 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aba72-1cd4-43dd-be71-e3bfc7b641f5 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:22.961302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fe1c3-e44f-4840-a6be-9f281caa4018 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:22.994061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1177c-026a-4cf4-b894-c78389f0dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:22.994723 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1177c-026a-4cf4-b894-c78389f0dd8d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.995008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1177c-026a-4cf4-b894-c78389f0dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.995286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1177c-026a-4cf4-b894-c78389f0dd8d None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.996011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1177c-026a-4cf4-b894-c78389f0dd8d None admin] RBAC: Adding query filter params (type=network) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:22.996323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1177c-026a-4cf4-b894-c78389f0dd8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:22.997675 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1177c-026a-4cf4-b894-c78389f0dd8d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.002850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 406/813] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:23.003615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1177c-026a-4cf4-b894-c78389f0dd8d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.052865 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287aba72-1cd4-43dd-be71-e3bfc7b641f5 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.086288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc133c2a-6df1-41ee-9276-525c4ecc0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.087128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133c2a-6df1-41ee-9276-525c4ecc0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.087415 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133c2a-6df1-41ee-9276-525c4ecc0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.087694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc133c2a-6df1-41ee-9276-525c4ecc0eb9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.088380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc133c2a-6df1-41ee-9276-525c4ecc0eb9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.089736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc133c2a-6df1-41ee-9276-525c4ecc0eb9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.101234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1177c-026a-4cf4-b894-c78389f0dd8d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-fc133c2a-6df1-41ee-9276-525c4ecc0eb9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:23.102491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:23.103587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:23.109308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 408/814] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Jun 16 00:12:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:23.110335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc133c2a-6df1-41ee-9276-525c4ecc0eb9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.126495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:23.132449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:23.144281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edcf06-be00-469e-90f9-185ee8890d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.144944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edcf06-be00-469e-90f9-185ee8890d29 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.145231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edcf06-be00-469e-90f9-185ee8890d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.145515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edcf06-be00-469e-90f9-185ee8890d29 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.146259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edcf06-be00-469e-90f9-185ee8890d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:23.146571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edcf06-be00-469e-90f9-185ee8890d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.147934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edcf06-be00-469e-90f9-185ee8890d29 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.160101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 407/815] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:23.160730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edcf06-be00-469e-90f9-185ee8890d29 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.205876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc133c2a-6df1-41ee-9276-525c4ecc0eb9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.241145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cd12e-73e6-483d-905d-55098ae359b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.241939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cd12e-73e6-483d-905d-55098ae359b7 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.242229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cd12e-73e6-483d-905d-55098ae359b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.242505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cd12e-73e6-483d-905d-55098ae359b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.249145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cd12e-73e6-483d-905d-55098ae359b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.250584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cd12e-73e6-483d-905d-55098ae359b7 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.259457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edcf06-be00-469e-90f9-185ee8890d29 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-ad6cd12e-73e6-483d-905d-55098ae359b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:23.264615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:23.265472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:23.266354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:23.266354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:23.266354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:23.266354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:23.266354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:23.266354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:23.266354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:23.266354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:23.266354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 409/816] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:23.266829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cd12e-73e6-483d-905d-55098ae359b7 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.297618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f815b-a567-4956-be7e-b86be814901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.298719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f815b-a567-4956-be7e-b86be814901b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.299072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f815b-a567-4956-be7e-b86be814901b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.299550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f815b-a567-4956-be7e-b86be814901b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.306850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f815b-a567-4956-be7e-b86be814901b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.308265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f815b-a567-4956-be7e-b86be814901b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-7c9f815b-a567-4956-be7e-b86be814901b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:23.322496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:23.323622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:23.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:23.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:23.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:23.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:23.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:23.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:23.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:23.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:23.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:12:23.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:23.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 408/817] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:23.325190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f815b-a567-4956-be7e-b86be814901b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.355891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:23.368556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:23.368696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cd12e-73e6-483d-905d-55098ae359b7 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.403225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef0279-db11-48fe-8c0e-8f7ddc6bbed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.403885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0279-db11-48fe-8c0e-8f7ddc6bbed9 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.404209 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0279-db11-48fe-8c0e-8f7ddc6bbed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.404492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0279-db11-48fe-8c0e-8f7ddc6bbed9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.405228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef0279-db11-48fe-8c0e-8f7ddc6bbed9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.406597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef0279-db11-48fe-8c0e-8f7ddc6bbed9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.427030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 410/818] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 16 00:12:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:23.427577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f815b-a567-4956-be7e-b86be814901b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.427825 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef0279-db11-48fe-8c0e-8f7ddc6bbed9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.473763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead00278-64c3-416e-b5f1-888aad9981b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.474452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00278-64c3-416e-b5f1-888aad9981b8 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.474740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00278-64c3-416e-b5f1-888aad9981b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.475049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00278-64c3-416e-b5f1-888aad9981b8 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.475782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead00278-64c3-416e-b5f1-888aad9981b8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:23.476128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead00278-64c3-416e-b5f1-888aad9981b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.477584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead00278-64c3-416e-b5f1-888aad9981b8 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.482888 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 409/819] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:23.483770 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead00278-64c3-416e-b5f1-888aad9981b8 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.563104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef0279-db11-48fe-8c0e-8f7ddc6bbed9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.595521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:23.602030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead00278-64c3-416e-b5f1-888aad9981b8 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.606698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2a36-0f6e-49e4-8516-b880e270bac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.608054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2a36-0f6e-49e4-8516-b880e270bac6 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.608054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2a36-0f6e-49e4-8516-b880e270bac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.608054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd2a36-0f6e-49e4-8516-b880e270bac6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.617181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd2a36-0f6e-49e4-8516-b880e270bac6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.619418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd2a36-0f6e-49e4-8516-b880e270bac6 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-30fd2a36-0f6e-49e4-8516-b880e270bac6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:23.639016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:23.639950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:23.640873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:23.640873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:23.640873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:23.640873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:23.640873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:23.640873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:23.640873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:23.640873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:23.640873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 411/820] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:23.641359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2a36-0f6e-49e4-8516-b880e270bac6 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.644862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:23.649670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85e333-0f03-4bb7-b7a9-c94fdb501cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.650838 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85e333-0f03-4bb7-b7a9-c94fdb501cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.651127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85e333-0f03-4bb7-b7a9-c94fdb501cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.651432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85e333-0f03-4bb7-b7a9-c94fdb501cf8 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.652232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85e333-0f03-4bb7-b7a9-c94fdb501cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:23.652920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85e333-0f03-4bb7-b7a9-c94fdb501cf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.654715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85e333-0f03-4bb7-b7a9-c94fdb501cf8 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.667118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 410/821] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:23.667922 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85e333-0f03-4bb7-b7a9-c94fdb501cf8 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.750043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd2a36-0f6e-49e4-8516-b880e270bac6 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.773498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85e333-0f03-4bb7-b7a9-c94fdb501cf8 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.787484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b8c92-a796-40a8-93a6-3936898b968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.788206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b8c92-a796-40a8-93a6-3936898b968e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.788494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b8c92-a796-40a8-93a6-3936898b968e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.788774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b8c92-a796-40a8-93a6-3936898b968e None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.789627 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b8c92-a796-40a8-93a6-3936898b968e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:23.789945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b8c92-a796-40a8-93a6-3936898b968e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.791387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b8c92-a796-40a8-93a6-3936898b968e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.811222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 412/822] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:23.812048 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b8c92-a796-40a8-93a6-3936898b968e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.819706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21879ca-3111-4d6f-8ba3-f127da5b1042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.820369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21879ca-3111-4d6f-8ba3-f127da5b1042 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.820657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21879ca-3111-4d6f-8ba3-f127da5b1042 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.820939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21879ca-3111-4d6f-8ba3-f127da5b1042 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.822090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21879ca-3111-4d6f-8ba3-f127da5b1042 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:23.822415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21879ca-3111-4d6f-8ba3-f127da5b1042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.824212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21879ca-3111-4d6f-8ba3-f127da5b1042 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.829906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 411/823] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:23.830772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21879ca-3111-4d6f-8ba3-f127da5b1042 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.857850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:23.883876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:23.924567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b8c92-a796-40a8-93a6-3936898b968e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.941984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21879ca-3111-4d6f-8ba3-f127da5b1042 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.960298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525dd26-a3a3-4594-ab45-ce07d29af44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.960962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525dd26-a3a3-4594-ab45-ce07d29af44d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.961249 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525dd26-a3a3-4594-ab45-ce07d29af44d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.961530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525dd26-a3a3-4594-ab45-ce07d29af44d None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.962311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525dd26-a3a3-4594-ab45-ce07d29af44d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:23.962624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525dd26-a3a3-4594-ab45-ce07d29af44d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.964079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525dd26-a3a3-4594-ab45-ce07d29af44d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.981669 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 413/824] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:23.981669 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525dd26-a3a3-4594-ab45-ce07d29af44d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.985065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818c430-8f92-437f-8e7b-eecdccb172b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.985750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818c430-8f92-437f-8e7b-eecdccb172b0 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.986054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818c430-8f92-437f-8e7b-eecdccb172b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.986382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818c430-8f92-437f-8e7b-eecdccb172b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.988312 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818c430-8f92-437f-8e7b-eecdccb172b0 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=cd57046b084b463488296b825097081d) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:23.988676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818c430-8f92-437f-8e7b-eecdccb172b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.990202 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818c430-8f92-437f-8e7b-eecdccb172b0 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.996964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 412/825] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/role_assignments?user.id=cd57046b084b463488296b825097081d&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:23.997698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818c430-8f92-437f-8e7b-eecdccb172b0 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:24.102965 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:24.110885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525dd26-a3a3-4594-ab45-ce07d29af44d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:24.119134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818c430-8f92-437f-8e7b-eecdccb172b0 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:24.137368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:24.151746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e1a2e-5f6e-4277-a386-1ec19fbf8232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:24.152613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e1a2e-5f6e-4277-a386-1ec19fbf8232 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:24.152898 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e1a2e-5f6e-4277-a386-1ec19fbf8232 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:24.153175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e1a2e-5f6e-4277-a386-1ec19fbf8232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:24.154809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e58b4-1ecf-41fd-b270-df683b7d46fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:24.155474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e58b4-1ecf-41fd-b270-df683b7d46fd None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:24.155757 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e58b4-1ecf-41fd-b270-df683b7d46fd None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:24.156055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e58b4-1ecf-41fd-b270-df683b7d46fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:24.156811 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e58b4-1ecf-41fd-b270-df683b7d46fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:24.158205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e58b4-1ecf-41fd-b270-df683b7d46fd None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:24.165586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e1a2e-5f6e-4277-a386-1ec19fbf8232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:24.167029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e1a2e-5f6e-4277-a386-1ec19fbf8232 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:24.181227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 413/826] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 16 00:12:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:24.182041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e58b4-1ecf-41fd-b270-df683b7d46fd None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-217e1a2e-5f6e-4277-a386-1ec19fbf8232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:24.187402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:24.188443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:24.189347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:24.189347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:24.189347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:24.189347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:24.192164 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 414/827] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:24.194453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e1a2e-5f6e-4277-a386-1ec19fbf8232 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:24.339145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e58b4-1ecf-41fd-b270-df683b7d46fd None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:24.339779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e1a2e-5f6e-4277-a386-1ec19fbf8232 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:24.382328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d917-d4a4-4686-bd26-6edb6ae1db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:24.383410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d917-d4a4-4686-bd26-6edb6ae1db4c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:24.383616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83e643-fac5-4b04-8ea7-4d7b72f18e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:24.384162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d917-d4a4-4686-bd26-6edb6ae1db4c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:24.384547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e643-fac5-4b04-8ea7-4d7b72f18e74 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:24.384890 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e643-fac5-4b04-8ea7-4d7b72f18e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:24.384995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d917-d4a4-4686-bd26-6edb6ae1db4c None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:24.385173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83e643-fac5-4b04-8ea7-4d7b72f18e74 None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/1fc6d76795694d91b41b8bf819728aae/roles/b8116338d60f4b38ba6e70a4726765f2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:24.386178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58d917-d4a4-4686-bd26-6edb6ae1db4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:24.386853 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58d917-d4a4-4686-bd26-6edb6ae1db4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:24.389298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58d917-d4a4-4686-bd26-6edb6ae1db4c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:24.397162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:24.405720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 415/828] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:24.410680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83e643-fac5-4b04-8ea7-4d7b72f18e74 None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=1fc6d76795694d91b41b8bf819728aae, role_id=b8116338d60f4b38ba6e70a4726765f2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:24.410680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83e643-fac5-4b04-8ea7-4d7b72f18e74 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:24.412180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d917-d4a4-4686-bd26-6edb6ae1db4c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:24.427086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 414/829] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:12:24 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/1fc6d76795694d91b41b8bf819728aae/roles/b8116338d60f4b38ba6e70a4726765f2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:12:24.458988 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:24.536794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d917-d4a4-4686-bd26-6edb6ae1db4c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:24.576452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72fedd-e351-422a-a6ce-12cb803863d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:24.577279 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72fedd-e351-422a-a6ce-12cb803863d9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:24.577562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72fedd-e351-422a-a6ce-12cb803863d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:24.577837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72fedd-e351-422a-a6ce-12cb803863d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:24.586723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72fedd-e351-422a-a6ce-12cb803863d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:24.588282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72fedd-e351-422a-a6ce-12cb803863d9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-5b72fedd-e351-422a-a6ce-12cb803863d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:24.603721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:24.604757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:24.606147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:24.606147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:24.606147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:24.606147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:24.606147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:24.606147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:24.606147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:24.606147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:24.606147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 416/830] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:24.611005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83e643-fac5-4b04-8ea7-4d7b72f18e74 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:24.722773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83e643-fac5-4b04-8ea7-4d7b72f18e74 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:24.758677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd0eba-0ae1-4934-bb68-7acfea96b443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:24.759347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd0eba-0ae1-4934-bb68-7acfea96b443 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:24.759633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd0eba-0ae1-4934-bb68-7acfea96b443 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:24.759913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd0eba-0ae1-4934-bb68-7acfea96b443 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:24.760736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd0eba-0ae1-4934-bb68-7acfea96b443 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:24.761048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd0eba-0ae1-4934-bb68-7acfea96b443 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:24.762492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd0eba-0ae1-4934-bb68-7acfea96b443 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:24.775638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 415/831] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:24.781535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72fedd-e351-422a-a6ce-12cb803863d9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:24.879653 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:24.886335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72fedd-e351-422a-a6ce-12cb803863d9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:24.921390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181dda5-40e7-4388-9437-ff47ecaeaa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:24.922290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181dda5-40e7-4388-9437-ff47ecaeaa02 None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:24.922575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181dda5-40e7-4388-9437-ff47ecaeaa02 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:24.922858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181dda5-40e7-4388-9437-ff47ecaeaa02 None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/88d67d41124c4deda1c5ecdab82d3055/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:24.925423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181dda5-40e7-4388-9437-ff47ecaeaa02 None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=88d67d41124c4deda1c5ecdab82d3055, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:24.926868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181dda5-40e7-4388-9437-ff47ecaeaa02 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:24.943997 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 417/832] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:12:24 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/88d67d41124c4deda1c5ecdab82d3055/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:12:26.261682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412842d4-24eb-43a8-8637-8362fb9714d4 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:26.262595 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412842d4-24eb-43a8-8637-8362fb9714d4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:26.263030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412842d4-24eb-43a8-8637-8362fb9714d4 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:26.264819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 416/833] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:26.270951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34f09e-2f08-4a5d-87aa-20d0ef82b118 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:26.271687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34f09e-2f08-4a5d-87aa-20d0ef82b118 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:26.272154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34f09e-2f08-4a5d-87aa-20d0ef82b118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:26.289927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-8d34f09e-2f08-4a5d-87aa-20d0ef82b118 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:26.291362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8d34f09e-2f08-4a5d-87aa-20d0ef82b118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:26.360163 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 418/834] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:26.382452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412842d4-24eb-43a8-8637-8362fb9714d4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:26.439292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:26.470126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f7758-bd7d-4d37-ade1-98ad33e3c0c6 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:26.470792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f7758-bd7d-4d37-ade1-98ad33e3c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:26.471342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f7758-bd7d-4d37-ade1-98ad33e3c0c6 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:26.474148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 419/835] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:26.478318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8b3c-5225-4e61-9d34-41e7e9731c17 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:26.478840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8b3c-5225-4e61-9d34-41e7e9731c17 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:26.479345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8b3c-5225-4e61-9d34-41e7e9731c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:26.496103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412842d4-24eb-43a8-8637-8362fb9714d4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:26.498110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-002c8b3c-5225-4e61-9d34-41e7e9731c17 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:26.499584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-002c8b3c-5225-4e61-9d34-41e7e9731c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:26.541392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51f80e-d190-4d2a-9bb3-44a27a2bc7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:26.542155 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51f80e-d190-4d2a-9bb3-44a27a2bc7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:26.543334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51f80e-d190-4d2a-9bb3-44a27a2bc7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:26.543648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51f80e-d190-4d2a-9bb3-44a27a2bc7b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:26.544360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51f80e-d190-4d2a-9bb3-44a27a2bc7b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:26.545756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51f80e-d190-4d2a-9bb3-44a27a2bc7b4 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-8e51f80e-d190-4d2a-9bb3-44a27a2bc7b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:26.561978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:26.562991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:26.564330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 417/836] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Jun 16 00:12:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:26.569434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51f80e-d190-4d2a-9bb3-44a27a2bc7b4 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:26.583809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 420/837] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:26.585646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e4e6-152e-4ffb-a629-185af149fdd7 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:26.585939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e4e6-152e-4ffb-a629-185af149fdd7 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:26.586257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e4e6-152e-4ffb-a629-185af149fdd7 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:26.587751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 421/838] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:26.593918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dac05d-8524-4631-b5ee-8592a53b52ca None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:26.594211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dac05d-8524-4631-b5ee-8592a53b52ca None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:26.594493 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dac05d-8524-4631-b5ee-8592a53b52ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:26.612093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-83dac05d-8524-4631-b5ee-8592a53b52ca None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:26.613277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-83dac05d-8524-4631-b5ee-8592a53b52ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:26.623343 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:26.680386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51f80e-d190-4d2a-9bb3-44a27a2bc7b4 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:26.696376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 422/839] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:26.696376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dac05d-8524-4631-b5ee-8592a53b52ca None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:26.696640 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:26.726314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3743-38cb-42f4-9ea5-201c1e5190a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:26.727075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3743-38cb-42f4-9ea5-201c1e5190a9 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:26.727367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3743-38cb-42f4-9ea5-201c1e5190a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:26.727671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3743-38cb-42f4-9ea5-201c1e5190a9 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:26.728397 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e3743-38cb-42f4-9ea5-201c1e5190a9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:26.728712 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e3743-38cb-42f4-9ea5-201c1e5190a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:26.730094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e3743-38cb-42f4-9ea5-201c1e5190a9 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:26.734959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 418/840] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 16 00:12:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:26.740416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3743-38cb-42f4-9ea5-201c1e5190a9 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:26.803782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dac05d-8524-4631-b5ee-8592a53b52ca None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:26.840077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f908078-9099-4a20-aacb-0e2881b11f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:26.841382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f908078-9099-4a20-aacb-0e2881b11f28 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:26.841667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f908078-9099-4a20-aacb-0e2881b11f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:26.841942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f908078-9099-4a20-aacb-0e2881b11f28 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:26.842590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f908078-9099-4a20-aacb-0e2881b11f28 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:26.843946 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f908078-9099-4a20-aacb-0e2881b11f28 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:26.844183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e3743-38cb-42f4-9ea5-201c1e5190a9 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-1f908078-9099-4a20-aacb-0e2881b11f28 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:26.857084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:26.858078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:26.858906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 423/841] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:26.860383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f908078-9099-4a20-aacb-0e2881b11f28 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:26.870271 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:26.885830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836d8bf-4f64-48e4-bfef-66901d60f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:26.886631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836d8bf-4f64-48e4-bfef-66901d60f3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:26.886914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836d8bf-4f64-48e4-bfef-66901d60f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:26.887197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836d8bf-4f64-48e4-bfef-66901d60f3c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:26.897848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836d8bf-4f64-48e4-bfef-66901d60f3c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-8836d8bf-4f64-48e4-bfef-66901d60f3c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:26.905667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:26.906691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:26.907516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 419/842] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:12:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:26.908789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836d8bf-4f64-48e4-bfef-66901d60f3c6 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:26.948776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:26.973466 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f908078-9099-4a20-aacb-0e2881b11f28 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:27.015200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836d8bf-4f64-48e4-bfef-66901d60f3c6 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:27.021918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e86b39-d57b-4f46-b3be-afeb6f7155e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:27.022633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86b39-d57b-4f46-b3be-afeb6f7155e2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.022921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86b39-d57b-4f46-b3be-afeb6f7155e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.023331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86b39-d57b-4f46-b3be-afeb6f7155e2 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.024119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e86b39-d57b-4f46-b3be-afeb6f7155e2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:27.024436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e86b39-d57b-4f46-b3be-afeb6f7155e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:27.025860 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e86b39-d57b-4f46-b3be-afeb6f7155e2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:27.031663 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 424/843] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 16 00:12:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:27.032493 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e86b39-d57b-4f46-b3be-afeb6f7155e2 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:27.074253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e97bf-3ec9-4a2d-81b5-5e7a0b17dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:27.076372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e97bf-3ec9-4a2d-81b5-5e7a0b17dc38 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.076870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e97bf-3ec9-4a2d-81b5-5e7a0b17dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.077299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e97bf-3ec9-4a2d-81b5-5e7a0b17dc38 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.078180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e97bf-3ec9-4a2d-81b5-5e7a0b17dc38 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:27.078638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e97bf-3ec9-4a2d-81b5-5e7a0b17dc38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:27.080783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e97bf-3ec9-4a2d-81b5-5e7a0b17dc38 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:27.088630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 420/844] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:27.094018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9258a-a637-4fe2-9381-ff3f69a73fd1 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.094610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9258a-a637-4fe2-9381-ff3f69a73fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.094913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9258a-a637-4fe2-9381-ff3f69a73fd1 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.096611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 421/845] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:27.097210 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9258a-a637-4fe2-9381-ff3f69a73fd1 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:27.117052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:27.152188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e86b39-d57b-4f46-b3be-afeb6f7155e2 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:27.190255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4d67f-9ea2-4ecb-9403-6d9a518fbe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:27.190971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4d67f-9ea2-4ecb-9403-6d9a518fbe27 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.191258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4d67f-9ea2-4ecb-9403-6d9a518fbe27 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.191538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4d67f-9ea2-4ecb-9403-6d9a518fbe27 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.192332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4d67f-9ea2-4ecb-9403-6d9a518fbe27 None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:27.192649 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4d67f-9ea2-4ecb-9403-6d9a518fbe27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:27.194038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4d67f-9ea2-4ecb-9403-6d9a518fbe27 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:27.203115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 425/846] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:27.204497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecd59-b46c-4a2a-b9ed-d287cd31f460 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.204849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecd59-b46c-4a2a-b9ed-d287cd31f460 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.205685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecd59-b46c-4a2a-b9ed-d287cd31f460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.212241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:27.217155 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9258a-a637-4fe2-9381-ff3f69a73fd1 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:27.223534 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d91ecd59-b46c-4a2a-b9ed-d287cd31f460 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:27.224767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d91ecd59-b46c-4a2a-b9ed-d287cd31f460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:27.256253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624253aa-1c05-495b-95d5-e116e32fd9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:27.256928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624253aa-1c05-495b-95d5-e116e32fd9bc None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.257213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624253aa-1c05-495b-95d5-e116e32fd9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.257491 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624253aa-1c05-495b-95d5-e116e32fd9bc None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.258200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624253aa-1c05-495b-95d5-e116e32fd9bc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:27.258514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624253aa-1c05-495b-95d5-e116e32fd9bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:27.259920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624253aa-1c05-495b-95d5-e116e32fd9bc None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:27.264562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 422/847] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:27.265445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624253aa-1c05-495b-95d5-e116e32fd9bc None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:27.311711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 426/848] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:27.342431 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ecd59-b46c-4a2a-b9ed-d287cd31f460 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:27.388746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624253aa-1c05-495b-95d5-e116e32fd9bc None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:27.414037 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:27.426907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532fc49-19b8-4423-8c7c-ac1cf0eb54d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:27.427887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532fc49-19b8-4423-8c7c-ac1cf0eb54d6 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.428319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532fc49-19b8-4423-8c7c-ac1cf0eb54d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.428699 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532fc49-19b8-4423-8c7c-ac1cf0eb54d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.441602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532fc49-19b8-4423-8c7c-ac1cf0eb54d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:27.443713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532fc49-19b8-4423-8c7c-ac1cf0eb54d6 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:27.457360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ecd59-b46c-4a2a-b9ed-d287cd31f460 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-9532fc49-19b8-4423-8c7c-ac1cf0eb54d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:27.462135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:27.463023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:27.463911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:27.463911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:27.463911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:27.463911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:27.463911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 423/849] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:27.469384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532fc49-19b8-4423-8c7c-ac1cf0eb54d6 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:27.495278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e885b3f-986a-4b21-ae82-f6a67676e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:27.496127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e885b3f-986a-4b21-ae82-f6a67676e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.496414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e885b3f-986a-4b21-ae82-f6a67676e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.496692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e885b3f-986a-4b21-ae82-f6a67676e6b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.497489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:27.510376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e885b3f-986a-4b21-ae82-f6a67676e6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-5e885b3f-986a-4b21-ae82-f6a67676e6b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:27.518508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:27.519533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:27.520424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 427/850] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:27.525818 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e885b3f-986a-4b21-ae82-f6a67676e6b2 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:27.586011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532fc49-19b8-4423-8c7c-ac1cf0eb54d6 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:27.621620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafb9c4-3b16-4b0d-9e61-4b472009cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:27.622203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafb9c4-3b16-4b0d-9e61-4b472009cb2f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.622538 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafb9c4-3b16-4b0d-9e61-4b472009cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.622824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafb9c4-3b16-4b0d-9e61-4b472009cb2f None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.623544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafb9c4-3b16-4b0d-9e61-4b472009cb2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:27.623853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafb9c4-3b16-4b0d-9e61-4b472009cb2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:27.625257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafb9c4-3b16-4b0d-9e61-4b472009cb2f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:27.629412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e885b3f-986a-4b21-ae82-f6a67676e6b2 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:27.638701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 424/851] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:27.643990 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafb9c4-3b16-4b0d-9e61-4b472009cb2f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:27.653220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:27.665052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842667c-5dff-4a3a-95bf-99c2b671d78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:27.665726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842667c-5dff-4a3a-95bf-99c2b671d78b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.666006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842667c-5dff-4a3a-95bf-99c2b671d78b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.666294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842667c-5dff-4a3a-95bf-99c2b671d78b None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.667455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842667c-5dff-4a3a-95bf-99c2b671d78b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:27.668135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842667c-5dff-4a3a-95bf-99c2b671d78b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:27.669602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842667c-5dff-4a3a-95bf-99c2b671d78b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:27.683999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 428/852] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:27.685200 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842667c-5dff-4a3a-95bf-99c2b671d78b None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:27.763121 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafb9c4-3b16-4b0d-9e61-4b472009cb2f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:27.796504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:27.802188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f21c5-8c1e-46d4-a61d-885dc75cda2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:27.803179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f21c5-8c1e-46d4-a61d-885dc75cda2c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.803566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f21c5-8c1e-46d4-a61d-885dc75cda2c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.803976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f21c5-8c1e-46d4-a61d-885dc75cda2c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.813234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f21c5-8c1e-46d4-a61d-885dc75cda2c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:27.814992 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f21c5-8c1e-46d4-a61d-885dc75cda2c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-8e3f21c5-8c1e-46d4-a61d-885dc75cda2c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:27.837366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:27.839701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:27.842231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:27.842231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:27.842231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:27.842231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:27.842231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:27.842231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:27.842231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:27.842231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:27.842231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:27.842231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:27.848027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 425/853] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 16 00:12:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:27.849642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f21c5-8c1e-46d4-a61d-885dc75cda2c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:27.944665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842667c-5dff-4a3a-95bf-99c2b671d78b None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:27.967251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f21c5-8c1e-46d4-a61d-885dc75cda2c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:27.987721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f82160-369e-4032-b198-65834056a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:27.989572 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f82160-369e-4032-b198-65834056a26a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.990358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f82160-369e-4032-b198-65834056a26a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.991070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f82160-369e-4032-b198-65834056a26a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.007261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f82160-369e-4032-b198-65834056a26a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.009592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f82160-369e-4032-b198-65834056a26a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.010647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e439a-73a0-4b55-b939-3b03c0dd96cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.011409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e439a-73a0-4b55-b939-3b03c0dd96cd None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.011776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e439a-73a0-4b55-b939-3b03c0dd96cd None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.012445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e439a-73a0-4b55-b939-3b03c0dd96cd None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.014348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e439a-73a0-4b55-b939-3b03c0dd96cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:28.014739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e439a-73a0-4b55-b939-3b03c0dd96cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.016277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e439a-73a0-4b55-b939-3b03c0dd96cd None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.022178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-36f82160-369e-4032-b198-65834056a26a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:28.032616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:28.033609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:28.034651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:28.034651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:28.034651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:28.034651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:28.045241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 429/854] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:28.045407 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 426/855] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 16 00:12:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:28.045407 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e439a-73a0-4b55-b939-3b03c0dd96cd None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.046494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f82160-369e-4032-b198-65834056a26a None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.095794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.158907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e439a-73a0-4b55-b939-3b03c0dd96cd None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.174959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f82160-369e-4032-b198-65834056a26a None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.199079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa39d-401a-416e-ad6f-5d2cc61146f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.200228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa39d-401a-416e-ad6f-5d2cc61146f9 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.200722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa39d-401a-416e-ad6f-5d2cc61146f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.201208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa39d-401a-416e-ad6f-5d2cc61146f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.202134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aa39d-401a-416e-ad6f-5d2cc61146f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:28.202768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aa39d-401a-416e-ad6f-5d2cc61146f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.204566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aa39d-401a-416e-ad6f-5d2cc61146f9 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.215792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8dccb-816b-4462-b24f-5c2987451128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.216738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8dccb-816b-4462-b24f-5c2987451128 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.217031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8dccb-816b-4462-b24f-5c2987451128 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.217310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8dccb-816b-4462-b24f-5c2987451128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.219521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 427/856] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:28.226438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa39d-401a-416e-ad6f-5d2cc61146f9 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.300277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.306044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8dccb-816b-4462-b24f-5c2987451128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.307505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a8dccb-816b-4462-b24f-5c2987451128 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.349947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.372622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa39d-401a-416e-ad6f-5d2cc61146f9 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.407398 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f928-3c56-4724-9b9a-16b295c17d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.408732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f928-3c56-4724-9b9a-16b295c17d05 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.409016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f928-3c56-4724-9b9a-16b295c17d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.409292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f928-3c56-4724-9b9a-16b295c17d05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.417683 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32f928-3c56-4724-9b9a-16b295c17d05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.419140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32f928-3c56-4724-9b9a-16b295c17d05 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-5f32f928-3c56-4724-9b9a-16b295c17d05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:28.438655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:28.440246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:28.441191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:28.441191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:28.441191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:28.441191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:28.441191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:28.441191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:28.441191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:28.441191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:28.441191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:12:28.441191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:28.441191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 428/857] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:28.442829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 430/858] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:12:28.443522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f928-3c56-4724-9b9a-16b295c17d05 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.444375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8dccb-816b-4462-b24f-5c2987451128 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.561800 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f928-3c56-4724-9b9a-16b295c17d05 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.576989 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.580815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8dccb-816b-4462-b24f-5c2987451128 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.604257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a770-bf61-4f11-bf0b-0d39fe8e8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.604881 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a770-bf61-4f11-bf0b-0d39fe8e8a35 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.605169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a770-bf61-4f11-bf0b-0d39fe8e8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.605445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4a770-bf61-4f11-bf0b-0d39fe8e8a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.616648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4a770-bf61-4f11-bf0b-0d39fe8e8a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.618092 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4a770-bf61-4f11-bf0b-0d39fe8e8a35 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.634374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5600c6d-76fe-4ebb-abf3-a28120adb520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-16c4a770-bf61-4f11-bf0b-0d39fe8e8a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:28.635149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:28.636068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:28.636974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:28.636974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:28.636974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:28.636974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:28.637883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600c6d-76fe-4ebb-abf3-a28120adb520 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.638458 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600c6d-76fe-4ebb-abf3-a28120adb520 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.638948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600c6d-76fe-4ebb-abf3-a28120adb520 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.640043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5600c6d-76fe-4ebb-abf3-a28120adb520 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:28.640566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5600c6d-76fe-4ebb-abf3-a28120adb520 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.641112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 429/859] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:28.641934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a770-bf61-4f11-bf0b-0d39fe8e8a35 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.643304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5600c6d-76fe-4ebb-abf3-a28120adb520 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.654123 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.670522 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 431/860] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:28.676045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5600c6d-76fe-4ebb-abf3-a28120adb520 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.758661 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4a770-bf61-4f11-bf0b-0d39fe8e8a35 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.794455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141d01d-7a86-4965-a463-692679d1e8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.795124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d01d-7a86-4965-a463-692679d1e8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.795680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d01d-7a86-4965-a463-692679d1e8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.795957 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141d01d-7a86-4965-a463-692679d1e8a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.796700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141d01d-7a86-4965-a463-692679d1e8a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:28.797059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141d01d-7a86-4965-a463-692679d1e8a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.798432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141d01d-7a86-4965-a463-692679d1e8a7 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.810062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5600c6d-76fe-4ebb-abf3-a28120adb520 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.815639 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 430/861] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:28.816502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141d01d-7a86-4965-a463-692679d1e8a7 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.844313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.849333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427157d-cacd-4622-8780-8c02085c5abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.850437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427157d-cacd-4622-8780-8c02085c5abd None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.850935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427157d-cacd-4622-8780-8c02085c5abd None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.851468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427157d-cacd-4622-8780-8c02085c5abd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.917896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.920078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141d01d-7a86-4965-a463-692679d1e8a7 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.926813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427157d-cacd-4622-8780-8c02085c5abd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.928633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427157d-cacd-4622-8780-8c02085c5abd None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.956583 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afaed3-6ec5-4c57-a6be-cb91095fc0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.957318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afaed3-6ec5-4c57-a6be-cb91095fc0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.957600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afaed3-6ec5-4c57-a6be-cb91095fc0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.957876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afaed3-6ec5-4c57-a6be-cb91095fc0f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.964809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afaed3-6ec5-4c57-a6be-cb91095fc0f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.966506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afaed3-6ec5-4c57-a6be-cb91095fc0f1 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-92afaed3-6ec5-4c57-a6be-cb91095fc0f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:28.981110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:28.982036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:28.982919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:28.982919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:28.982919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:28.982919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:28.982919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:28.982919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:28.982919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:28.982919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:28.987098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 431/862] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:28.987943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afaed3-6ec5-4c57-a6be-cb91095fc0f1 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:29.043668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 432/863] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:12:29.048882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427157d-cacd-4622-8780-8c02085c5abd None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:29.102500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:29.120262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afaed3-6ec5-4c57-a6be-cb91095fc0f1 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:29.157629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a66cd-40ac-48db-a860-efb121cea521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:29.158082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a66cd-40ac-48db-a860-efb121cea521 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.158911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a66cd-40ac-48db-a860-efb121cea521 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.159186 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a66cd-40ac-48db-a860-efb121cea521 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.160054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a66cd-40ac-48db-a860-efb121cea521 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:29.160335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a66cd-40ac-48db-a860-efb121cea521 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:29.161834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a66cd-40ac-48db-a860-efb121cea521 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:29.163444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:29.170302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427157d-cacd-4622-8780-8c02085c5abd None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:29.184322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 432/864] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:29.185750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a66cd-40ac-48db-a860-efb121cea521 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:29.210426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0e617-97de-428f-b0be-7cc8df26fdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:29.211614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e617-97de-428f-b0be-7cc8df26fdf9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.212140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e617-97de-428f-b0be-7cc8df26fdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.212624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e617-97de-428f-b0be-7cc8df26fdf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.224052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0e617-97de-428f-b0be-7cc8df26fdf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:29.225759 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0e617-97de-428f-b0be-7cc8df26fdf9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-81f0e617-97de-428f-b0be-7cc8df26fdf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:29.243723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:29.244697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:29.246181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:29.246181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:29.246181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:29.246181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:29.246181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 433/865] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:29.246775 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cfaf2-a1e2-4fc0-90e7-1f3a302fb56e None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.247075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cfaf2-a1e2-4fc0-90e7-1f3a302fb56e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.247374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cfaf2-a1e2-4fc0-90e7-1f3a302fb56e None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.251999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 434/866] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:29.251999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cfaf2-a1e2-4fc0-90e7-1f3a302fb56e None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:29.299687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a66cd-40ac-48db-a860-efb121cea521 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:29.334235 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77313ec5-d1a2-416e-a9af-3a60514522e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:29.334880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313ec5-d1a2-416e-a9af-3a60514522e2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.335404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313ec5-d1a2-416e-a9af-3a60514522e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.335515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313ec5-d1a2-416e-a9af-3a60514522e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.336292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77313ec5-d1a2-416e-a9af-3a60514522e2 None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=1fc6d76795694d91b41b8bf819728aae) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:29.336612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77313ec5-d1a2-416e-a9af-3a60514522e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:29.338037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77313ec5-d1a2-416e-a9af-3a60514522e2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:29.344340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 433/867] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:29 2022] GET /identity/v3/role_assignments?user.id=1fc6d76795694d91b41b8bf819728aae&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:29.345519 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19567-97c2-4cb5-aab5-8fd7d854b6d2 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.345879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19567-97c2-4cb5-aab5-8fd7d854b6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.346161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f19567-97c2-4cb5-aab5-8fd7d854b6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.364651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e8f19567-97c2-4cb5-aab5-8fd7d854b6d2 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:29.365867 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e8f19567-97c2-4cb5-aab5-8fd7d854b6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:29.370228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:29.376218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cfaf2-a1e2-4fc0-90e7-1f3a302fb56e None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:29.424440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfe1dc-12b9-4426-ad3f-df4ec4947180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:29.425143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe1dc-12b9-4426-ad3f-df4ec4947180 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.425419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe1dc-12b9-4426-ad3f-df4ec4947180 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.425705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe1dc-12b9-4426-ad3f-df4ec4947180 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.426483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfe1dc-12b9-4426-ad3f-df4ec4947180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:29.426780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfe1dc-12b9-4426-ad3f-df4ec4947180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:29.428275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfe1dc-12b9-4426-ad3f-df4ec4947180 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:29.442437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 435/868] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:29.449174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfe1dc-12b9-4426-ad3f-df4ec4947180 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:29.465676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:29.479253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 434/869] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:29.483784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4125f-a549-4f5f-976e-ca2617f558fd None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.484129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4125f-a549-4f5f-976e-ca2617f558fd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.484420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4125f-a549-4f5f-976e-ca2617f558fd None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.486063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 435/870] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:29.493557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080974f-85f3-43f2-9a91-915e370786cd None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.493776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080974f-85f3-43f2-9a91-915e370786cd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.494000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080974f-85f3-43f2-9a91-915e370786cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.512067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e080974f-85f3-43f2-9a91-915e370786cd None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:29.513284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e080974f-85f3-43f2-9a91-915e370786cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:29.573959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfe1dc-12b9-4426-ad3f-df4ec4947180 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:29.599116 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 436/871] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:29.600267 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080974f-85f3-43f2-9a91-915e370786cd None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:29.618957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42231d2-481c-42c4-822e-15112bf60bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:29.620086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42231d2-481c-42c4-822e-15112bf60bed None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.620551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42231d2-481c-42c4-822e-15112bf60bed None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.621029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42231d2-481c-42c4-822e-15112bf60bed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.629184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42231d2-481c-42c4-822e-15112bf60bed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:29.630650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42231d2-481c-42c4-822e-15112bf60bed None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-e42231d2-481c-42c4-822e-15112bf60bed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:29.645790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:29.646686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:29.652899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:29.652899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:29.652899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:29.652899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:29.652899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:29.652899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:29.652899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:29.652899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:29.652899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 436/872] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:29.652899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42231d2-481c-42c4-822e-15112bf60bed None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:29.684356 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:29.714664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:29.720538 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080974f-85f3-43f2-9a91-915e370786cd None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:29.748527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42231d2-481c-42c4-822e-15112bf60bed None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:29.757924 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d593c27-b612-4a0d-982e-b78bd3717420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:29.758727 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593c27-b612-4a0d-982e-b78bd3717420 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.758863 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593c27-b612-4a0d-982e-b78bd3717420 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.759142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593c27-b612-4a0d-982e-b78bd3717420 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.759864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d593c27-b612-4a0d-982e-b78bd3717420 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:29.761296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d593c27-b612-4a0d-982e-b78bd3717420 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:29.776071 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 437/873] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:12:29 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:29.776791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d593c27-b612-4a0d-982e-b78bd3717420 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:29.803260 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e188-9998-4bde-bd2c-1540e8099f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:29.804671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e188-9998-4bde-bd2c-1540e8099f00 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.805236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e188-9998-4bde-bd2c-1540e8099f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.805759 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e188-9998-4bde-bd2c-1540e8099f00 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.807670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071e188-9998-4bde-bd2c-1540e8099f00 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:29.810001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071e188-9998-4bde-bd2c-1540e8099f00 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:29.835597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 437/874] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:12:29 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:29.915901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d593c27-b612-4a0d-982e-b78bd3717420 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:29.953164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:29.967789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617ef37-ddd1-4c9d-b2f0-07bbe3e0d443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:29.968797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617ef37-ddd1-4c9d-b2f0-07bbe3e0d443 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:29.969259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617ef37-ddd1-4c9d-b2f0-07bbe3e0d443 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:29.969706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617ef37-ddd1-4c9d-b2f0-07bbe3e0d443 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:29.970684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617ef37-ddd1-4c9d-b2f0-07bbe3e0d443 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:29.971184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617ef37-ddd1-4c9d-b2f0-07bbe3e0d443 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:29.972832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617ef37-ddd1-4c9d-b2f0-07bbe3e0d443 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:29.989705 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 438/875] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:29.995881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e188-9998-4bde-bd2c-1540e8099f00 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:30.108250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e188-9998-4bde-bd2c-1540e8099f00 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:30.132699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:30.145707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f02aa-5dad-4d31-aa9b-663d98d02e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:30.146621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f02aa-5dad-4d31-aa9b-663d98d02e41 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:30.147050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f02aa-5dad-4d31-aa9b-663d98d02e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:30.147650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f02aa-5dad-4d31-aa9b-663d98d02e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:30.148680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f02aa-5dad-4d31-aa9b-663d98d02e41 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=88d67d41124c4deda1c5ecdab82d3055) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:30.149160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f02aa-5dad-4d31-aa9b-663d98d02e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:30.150788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f02aa-5dad-4d31-aa9b-663d98d02e41 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:30.157726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 438/876] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:29 2022] GET /identity/v3/role_assignments?user.id=88d67d41124c4deda1c5ecdab82d3055&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:31.591259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d8ebd-1dc5-4487-9cec-d4dc79256524 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.591784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d8ebd-1dc5-4487-9cec-d4dc79256524 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.591784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d8ebd-1dc5-4487-9cec-d4dc79256524 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.593446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 439/877] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:31.598718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb7c2-40c8-4b06-a7ce-72c0f1b796eb None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.599554 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb7c2-40c8-4b06-a7ce-72c0f1b796eb None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.600069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb7c2-40c8-4b06-a7ce-72c0f1b796eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.617639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-200cb7c2-40c8-4b06-a7ce-72c0f1b796eb None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:31.619144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-200cb7c2-40c8-4b06-a7ce-72c0f1b796eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:31.687109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 439/878] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:31.711119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d8ebd-1dc5-4487-9cec-d4dc79256524 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:31.816503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d8ebd-1dc5-4487-9cec-d4dc79256524 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:31.851902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d6ba3-80ea-43c1-9489-e5ada8de87e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:31.852687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6ba3-80ea-43c1-9489-e5ada8de87e8 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.852969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6ba3-80ea-43c1-9489-e5ada8de87e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.853244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d6ba3-80ea-43c1-9489-e5ada8de87e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.863648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d6ba3-80ea-43c1-9489-e5ada8de87e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-a19d6ba3-80ea-43c1-9489-e5ada8de87e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:31.871994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:31.872949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:31.873823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 440/879] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 16 00:12:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:31.881722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cb7c2-40c8-4b06-a7ce-72c0f1b796eb None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:31.990829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cb7c2-40c8-4b06-a7ce-72c0f1b796eb None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.009036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.012744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffad12e-02f0-495e-b9ce-9b69674889d4 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.013043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffad12e-02f0-495e-b9ce-9b69674889d4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.013352 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffad12e-02f0-495e-b9ce-9b69674889d4 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.022239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 441/880] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:32.027756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88145d9b-4ac9-4682-9256-91ffdb5a3fcf None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.028183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88145d9b-4ac9-4682-9256-91ffdb5a3fcf None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.028470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88145d9b-4ac9-4682-9256-91ffdb5a3fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.033732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68ecc5-07aa-4872-8c87-e0462b1649a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.034428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68ecc5-07aa-4872-8c87-e0462b1649a9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.034713 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68ecc5-07aa-4872-8c87-e0462b1649a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.034992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68ecc5-07aa-4872-8c87-e0462b1649a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.035765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68ecc5-07aa-4872-8c87-e0462b1649a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:32.036128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68ecc5-07aa-4872-8c87-e0462b1649a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.037553 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68ecc5-07aa-4872-8c87-e0462b1649a9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.047379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 440/881] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 16 00:12:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:32.047828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-88145d9b-4ac9-4682-9256-91ffdb5a3fcf None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:32.051808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-88145d9b-4ac9-4682-9256-91ffdb5a3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:32.054937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68ecc5-07aa-4872-8c87-e0462b1649a9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.110491 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.137550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 442/882] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:32.139100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7d842-02da-4584-adb4-a4a52caf5195 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.139560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7d842-02da-4584-adb4-a4a52caf5195 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.140021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7d842-02da-4584-adb4-a4a52caf5195 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.141654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 443/883] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:32.147418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34ebe8-55d6-4351-9687-30f0e1b63ad4 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.147902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34ebe8-55d6-4351-9687-30f0e1b63ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.148353 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34ebe8-55d6-4351-9687-30f0e1b63ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.168871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-cd34ebe8-55d6-4351-9687-30f0e1b63ad4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:32.170062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-cd34ebe8-55d6-4351-9687-30f0e1b63ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:32.176575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68ecc5-07aa-4872-8c87-e0462b1649a9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.210966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5e24-1f7b-45f1-b2f6-031c94e0b2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.211755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5e24-1f7b-45f1-b2f6-031c94e0b2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.212069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5e24-1f7b-45f1-b2f6-031c94e0b2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.212345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d5e24-1f7b-45f1-b2f6-031c94e0b2d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.223702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d5e24-1f7b-45f1-b2f6-031c94e0b2d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.225189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d5e24-1f7b-45f1-b2f6-031c94e0b2d2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.239814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 444/884] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:32.240542 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34ebe8-55d6-4351-9687-30f0e1b63ad4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-2f8d5e24-1f7b-45f1-b2f6-031c94e0b2d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:32.251302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:32.252958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:32.254628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:32.254628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:32.254628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:32.254628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:32.254628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 441/885] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:32.259780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5e24-1f7b-45f1-b2f6-031c94e0b2d2 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.296645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.356859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34ebe8-55d6-4351-9687-30f0e1b63ad4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.364557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.367631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d5e24-1f7b-45f1-b2f6-031c94e0b2d2 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.392861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91f89-3f98-44fe-93fd-651cd5ba8ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.393690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91f89-3f98-44fe-93fd-651cd5ba8ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.393976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91f89-3f98-44fe-93fd-651cd5ba8ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.394257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff91f89-3f98-44fe-93fd-651cd5ba8ee5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.394910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff91f89-3f98-44fe-93fd-651cd5ba8ee5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.396309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff91f89-3f98-44fe-93fd-651cd5ba8ee5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.401071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4ed94-8ff0-43bb-96f1-f4d53f8d468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.401725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ed94-8ff0-43bb-96f1-f4d53f8d468d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.402010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ed94-8ff0-43bb-96f1-f4d53f8d468d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.402284 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ed94-8ff0-43bb-96f1-f4d53f8d468d None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.402991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4ed94-8ff0-43bb-96f1-f4d53f8d468d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:32.403296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4ed94-8ff0-43bb-96f1-f4d53f8d468d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.404671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4ed94-8ff0-43bb-96f1-f4d53f8d468d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-1ff91f89-3f98-44fe-93fd-651cd5ba8ee5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:32.408346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:32.409326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:32.410230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 445/886] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:32.411236 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91f89-3f98-44fe-93fd-651cd5ba8ee5 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.419714 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 442/887] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:32.421002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7fd60-7961-4130-81c0-9df8be47d992 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.421289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7fd60-7961-4130-81c0-9df8be47d992 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.421563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7fd60-7961-4130-81c0-9df8be47d992 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.425117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 443/888] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:32.425117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7fd60-7961-4130-81c0-9df8be47d992 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.509859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff91f89-3f98-44fe-93fd-651cd5ba8ee5 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.515333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.526065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7fd60-7961-4130-81c0-9df8be47d992 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.542950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79afb0-9857-4d54-9097-f20704077bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.543751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79afb0-9857-4d54-9097-f20704077bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.544065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79afb0-9857-4d54-9097-f20704077bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.544349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79afb0-9857-4d54-9097-f20704077bd3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.545004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79afb0-9857-4d54-9097-f20704077bd3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.546365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79afb0-9857-4d54-9097-f20704077bd3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-bf79afb0-9857-4d54-9097-f20704077bd3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:32.558292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:32.559299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:32.560416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 446/889] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:32.561520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd65c9-b831-4d11-a892-49dc867c84eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.561622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79afb0-9857-4d54-9097-f20704077bd3 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.561710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd65c9-b831-4d11-a892-49dc867c84eb None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.561710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd65c9-b831-4d11-a892-49dc867c84eb None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.561710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd65c9-b831-4d11-a892-49dc867c84eb None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.561710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd65c9-b831-4d11-a892-49dc867c84eb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:32.562022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd65c9-b831-4d11-a892-49dc867c84eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.563226 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd65c9-b831-4d11-a892-49dc867c84eb None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.572858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 444/890] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:32.572858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8c0ac-3f99-46c9-9349-0463170a271e None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.572858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8c0ac-3f99-46c9-9349-0463170a271e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.572858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8c0ac-3f99-46c9-9349-0463170a271e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.586509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-edc8c0ac-3f99-46c9-9349-0463170a271e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:32.587683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-edc8c0ac-3f99-46c9-9349-0463170a271e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:32.598717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.653878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 445/891] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:32.654634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8c0ac-3f99-46c9-9349-0463170a271e None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.679319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79afb0-9857-4d54-9097-f20704077bd3 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.712366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154e242-a163-47f0-8c01-5a222f02e426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.713180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e242-a163-47f0-8c01-5a222f02e426 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.713465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e242-a163-47f0-8c01-5a222f02e426 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.713741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154e242-a163-47f0-8c01-5a222f02e426 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.722088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154e242-a163-47f0-8c01-5a222f02e426 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.723508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154e242-a163-47f0-8c01-5a222f02e426 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.736975 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-2154e242-a163-47f0-8c01-5a222f02e426 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:32.738263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:32.739275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 447/892] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:32.740596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154e242-a163-47f0-8c01-5a222f02e426 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.755193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8c0ac-3f99-46c9-9349-0463170a271e None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.789386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f26eb-6c25-4780-985e-c361fa20bf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.790056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f26eb-6c25-4780-985e-c361fa20bf25 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.790340 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f26eb-6c25-4780-985e-c361fa20bf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.790618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f26eb-6c25-4780-985e-c361fa20bf25 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.791324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f26eb-6c25-4780-985e-c361fa20bf25 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:32.791636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f26eb-6c25-4780-985e-c361fa20bf25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.793044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f26eb-6c25-4780-985e-c361fa20bf25 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.797674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 446/893] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:32.798488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f26eb-6c25-4780-985e-c361fa20bf25 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.832419 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.839276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154e242-a163-47f0-8c01-5a222f02e426 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.872536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056f2a-4ba3-450c-99b9-546c6591dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.873195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056f2a-4ba3-450c-99b9-546c6591dc8d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.873480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056f2a-4ba3-450c-99b9-546c6591dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.873756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056f2a-4ba3-450c-99b9-546c6591dc8d None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.874464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056f2a-4ba3-450c-99b9-546c6591dc8d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:32.874775 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056f2a-4ba3-450c-99b9-546c6591dc8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.876163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056f2a-4ba3-450c-99b9-546c6591dc8d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.880909 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 448/894] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:32.881677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056f2a-4ba3-450c-99b9-546c6591dc8d None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.894506 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f26eb-6c25-4780-985e-c361fa20bf25 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.927578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f1917-3a1a-4123-9382-d71b4ca0fd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.928422 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f1917-3a1a-4123-9382-d71b4ca0fd06 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.928703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f1917-3a1a-4123-9382-d71b4ca0fd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.928979 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f1917-3a1a-4123-9382-d71b4ca0fd06 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.929626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f1917-3a1a-4123-9382-d71b4ca0fd06 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.930972 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f1917-3a1a-4123-9382-d71b4ca0fd06 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-a86f1917-3a1a-4123-9382-d71b4ca0fd06 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:32.943316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:32.944482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:32.945812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 447/895] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:32.946799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f1917-3a1a-4123-9382-d71b4ca0fd06 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.960335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.980947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056f2a-4ba3-450c-99b9-546c6591dc8d None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.012966 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665e529-a5cd-45a0-9ba0-f38d9b0e941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.013647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e529-a5cd-45a0-9ba0-f38d9b0e941b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.013922 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e529-a5cd-45a0-9ba0-f38d9b0e941b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.014203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e529-a5cd-45a0-9ba0-f38d9b0e941b None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.015042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665e529-a5cd-45a0-9ba0-f38d9b0e941b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:33.015358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665e529-a5cd-45a0-9ba0-f38d9b0e941b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.016828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665e529-a5cd-45a0-9ba0-f38d9b0e941b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.034891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 449/896] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:33.035700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665e529-a5cd-45a0-9ba0-f38d9b0e941b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.046858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f1917-3a1a-4123-9382-d71b4ca0fd06 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.054263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:33.081483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40e967-8b65-48ae-ba01-ada8d7f58b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.082152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40e967-8b65-48ae-ba01-ada8d7f58b9e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.082441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40e967-8b65-48ae-ba01-ada8d7f58b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.082713 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40e967-8b65-48ae-ba01-ada8d7f58b9e None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.083426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40e967-8b65-48ae-ba01-ada8d7f58b9e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:33.083732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40e967-8b65-48ae-ba01-ada8d7f58b9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.085305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40e967-8b65-48ae-ba01-ada8d7f58b9e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.090735 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 448/897] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:33.091514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40e967-8b65-48ae-ba01-ada8d7f58b9e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.136095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665e529-a5cd-45a0-9ba0-f38d9b0e941b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.169723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:33.170395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae680f-9dad-494b-84f9-3ffdcb5c9d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.171079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae680f-9dad-494b-84f9-3ffdcb5c9d2e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.171398 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae680f-9dad-494b-84f9-3ffdcb5c9d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.171647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae680f-9dad-494b-84f9-3ffdcb5c9d2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.172536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae680f-9dad-494b-84f9-3ffdcb5c9d2e None admin] RBAC: Adding query filter params (interface=public, service_id=92c1a9e0c62f4b2c8d6f4941917eadbb, region_id=RegionOne) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:33.172827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae680f-9dad-494b-84f9-3ffdcb5c9d2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.174205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae680f-9dad-494b-84f9-3ffdcb5c9d2e None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.179517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 450/898] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 16 00:12:33 2022] GET /identity/v3/endpoints?service_id=92c1a9e0c62f4b2c8d6f4941917eadbb&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:33.179899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae680f-9dad-494b-84f9-3ffdcb5c9d2e None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.193036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40e967-8b65-48ae-ba01-ada8d7f58b9e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.226960 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764c08b-6c29-47cd-9b22-8f9305ca4176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.227633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764c08b-6c29-47cd-9b22-8f9305ca4176 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.227897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764c08b-6c29-47cd-9b22-8f9305ca4176 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.228205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764c08b-6c29-47cd-9b22-8f9305ca4176 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.228901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764c08b-6c29-47cd-9b22-8f9305ca4176 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:33.229205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764c08b-6c29-47cd-9b22-8f9305ca4176 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.230556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764c08b-6c29-47cd-9b22-8f9305ca4176 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.235015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 449/899] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 16 00:12:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:33.236063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764c08b-6c29-47cd-9b22-8f9305ca4176 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.261635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:33.281759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae680f-9dad-494b-84f9-3ffdcb5c9d2e None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.316044 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ad67b-7be0-46fa-b42e-8f5ead01b707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.316729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ad67b-7be0-46fa-b42e-8f5ead01b707 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.317017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ad67b-7be0-46fa-b42e-8f5ead01b707 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.317293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ad67b-7be0-46fa-b42e-8f5ead01b707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.335465 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764c08b-6c29-47cd-9b22-8f9305ca4176 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.368534 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9431f90-81b7-43b1-9013-c2a161b2c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.369182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9431f90-81b7-43b1-9013-c2a161b2c0fa None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.369474 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9431f90-81b7-43b1-9013-c2a161b2c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.369749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9431f90-81b7-43b1-9013-c2a161b2c0fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.370528 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9431f90-81b7-43b1-9013-c2a161b2c0fa None admin] RBAC: Adding query filter params (interface=public, service_id=d6d6f6bc83e54f6c881f74c78f6b45af, region_id=RegionOne) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:33.370842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9431f90-81b7-43b1-9013-c2a161b2c0fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.372224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9431f90-81b7-43b1-9013-c2a161b2c0fa None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.377436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 450/900] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 16 00:12:33 2022] GET /identity/v3/endpoints?service_id=d6d6f6bc83e54f6c881f74c78f6b45af&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:33.378227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9431f90-81b7-43b1-9013-c2a161b2c0fa None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.385329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ad67b-7be0-46fa-b42e-8f5ead01b707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.386773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ad67b-7be0-46fa-b42e-8f5ead01b707 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.388036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:33.464184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:33.477311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9431f90-81b7-43b1-9013-c2a161b2c0fa None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.484492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 451/901] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:33 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:12:33.485148 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ad67b-7be0-46fa-b42e-8f5ead01b707 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.509691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaefca9-1c9b-457c-be45-a239aa6d7abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.510355 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaefca9-1c9b-457c-be45-a239aa6d7abb None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.510632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaefca9-1c9b-457c-be45-a239aa6d7abb None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.510910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaefca9-1c9b-457c-be45-a239aa6d7abb None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.511582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaefca9-1c9b-457c-be45-a239aa6d7abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.512969 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaefca9-1c9b-457c-be45-a239aa6d7abb None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.518833 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 451/902] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 16 00:12:33 2022] GET /identity/v3/services => generated 1268 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:12:33.519587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaefca9-1c9b-457c-be45-a239aa6d7abb None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.592966 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ad67b-7be0-46fa-b42e-8f5ead01b707 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.608111 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:33.632899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3469dd-8708-41ff-85d8-f06168090986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.633587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3469dd-8708-41ff-85d8-f06168090986 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.633869 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3469dd-8708-41ff-85d8-f06168090986 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.634149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3469dd-8708-41ff-85d8-f06168090986 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.634872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3469dd-8708-41ff-85d8-f06168090986 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:33.635183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3469dd-8708-41ff-85d8-f06168090986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.636611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3469dd-8708-41ff-85d8-f06168090986 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.641872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 452/903] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 16 00:12:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:33.644975 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaefca9-1c9b-457c-be45-a239aa6d7abb None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.653289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3469dd-8708-41ff-85d8-f06168090986 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.696242 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9e7c2-2b12-43af-ba29-58d3a1399604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.697078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9e7c2-2b12-43af-ba29-58d3a1399604 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.697475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9e7c2-2b12-43af-ba29-58d3a1399604 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.697854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9e7c2-2b12-43af-ba29-58d3a1399604 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.698616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9e7c2-2b12-43af-ba29-58d3a1399604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.700128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9e7c2-2b12-43af-ba29-58d3a1399604 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.709137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 452/904] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 16 00:12:33 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:12:33.712096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:33.788719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3469dd-8708-41ff-85d8-f06168090986 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.831431 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68cf13-f4d7-4c51-b0b1-ce733354c2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.832295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68cf13-f4d7-4c51-b0b1-ce733354c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.832583 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68cf13-f4d7-4c51-b0b1-ce733354c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.832864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68cf13-f4d7-4c51-b0b1-ce733354c2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.845178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68cf13-f4d7-4c51-b0b1-ce733354c2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.846715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68cf13-f4d7-4c51-b0b1-ce733354c2c6 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-1b68cf13-f4d7-4c51-b0b1-ce733354c2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:33.868704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:33.869692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:33.870602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:33.870602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:33.870602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:33.870602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:33.874751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 453/905] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:33.876272 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9e7c2-2b12-43af-ba29-58d3a1399604 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.987729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9e7c2-2b12-43af-ba29-58d3a1399604 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:34.033602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e918c8-b69a-4fb2-b1e3-cbd4bc805b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:34.034314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e918c8-b69a-4fb2-b1e3-cbd4bc805b26 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:34.034594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e918c8-b69a-4fb2-b1e3-cbd4bc805b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:34.034917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e918c8-b69a-4fb2-b1e3-cbd4bc805b26 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:34.035645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e918c8-b69a-4fb2-b1e3-cbd4bc805b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:34.035947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e918c8-b69a-4fb2-b1e3-cbd4bc805b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:34.037396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e918c8-b69a-4fb2-b1e3-cbd4bc805b26 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:34.038903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:34.051111 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 453/906] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:34.056625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68cf13-f4d7-4c51-b0b1-ce733354c2c6 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:34.155168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:34.162494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68cf13-f4d7-4c51-b0b1-ce733354c2c6 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:34.198154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b87487-ed11-465d-af14-1b02789ce30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:34.198951 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b87487-ed11-465d-af14-1b02789ce30a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:34.199236 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b87487-ed11-465d-af14-1b02789ce30a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:34.199520 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b87487-ed11-465d-af14-1b02789ce30a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:34.206592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b87487-ed11-465d-af14-1b02789ce30a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:34.208069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b87487-ed11-465d-af14-1b02789ce30a None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-f9b87487-ed11-465d-af14-1b02789ce30a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:34.222830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:34.223779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:34.225004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:34.225004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:34.225004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:34.225004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:34.225004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:34.225004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:34.225004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:34.225004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:34.225004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 454/907] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:34.231898 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e918c8-b69a-4fb2-b1e3-cbd4bc805b26 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:34.339306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e918c8-b69a-4fb2-b1e3-cbd4bc805b26 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:34.374547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841512f-d4cc-45ff-a752-b18ccfda1e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:34.375210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841512f-d4cc-45ff-a752-b18ccfda1e44 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:34.375491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841512f-d4cc-45ff-a752-b18ccfda1e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:34.375764 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841512f-d4cc-45ff-a752-b18ccfda1e44 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:34.376578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841512f-d4cc-45ff-a752-b18ccfda1e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:34.377453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841512f-d4cc-45ff-a752-b18ccfda1e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:34.378883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841512f-d4cc-45ff-a752-b18ccfda1e44 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:34.391076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 454/908] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:34.397251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b87487-ed11-465d-af14-1b02789ce30a None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:34.501602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b87487-ed11-465d-af14-1b02789ce30a None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:34.536565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86af4ab-7106-415e-a022-1681eee535a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:34.537555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af4ab-7106-415e-a022-1681eee535a8 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:34.538147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af4ab-7106-415e-a022-1681eee535a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:34.538639 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af4ab-7106-415e-a022-1681eee535a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:34.539665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86af4ab-7106-415e-a022-1681eee535a8 None admin] RBAC: Adding query filter params (role.id=ae85f17673084352ab9b3953669ab67e, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=1fc6d76795694d91b41b8bf819728aae) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:34.540233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86af4ab-7106-415e-a022-1681eee535a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:34.541880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86af4ab-7106-415e-a022-1681eee535a8 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:34.552070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 455/909] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:34 2022] GET /identity/v3/role_assignments?user.id=1fc6d76795694d91b41b8bf819728aae&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=ae85f17673084352ab9b3953669ab67e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:35.692202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ae632-3698-4780-aec1-0c72e53d2a19 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.692723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ae632-3698-4780-aec1-0c72e53d2a19 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.692827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ae632-3698-4780-aec1-0c72e53d2a19 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.694370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 455/910] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:35.701265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf57791-b9c2-4e85-bd73-327e0ba66af7 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.701684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf57791-b9c2-4e85-bd73-327e0ba66af7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.702020 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf57791-b9c2-4e85-bd73-327e0ba66af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.718955 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-aaf57791-b9c2-4e85-bd73-327e0ba66af7 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:35.720168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-aaf57791-b9c2-4e85-bd73-327e0ba66af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:35.734678 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:35.793476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 456/911] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:35.816437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ae632-3698-4780-aec1-0c72e53d2a19 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:35.831742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecd794-604f-447d-9485-5b23052117dd None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.832084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecd794-604f-447d-9485-5b23052117dd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.832347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecd794-604f-447d-9485-5b23052117dd None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.833941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 457/912] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:35.838645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f834f7-58f7-46c4-b666-9fdf5212492c None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.838938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f834f7-58f7-46c4-b666-9fdf5212492c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.839218 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f834f7-58f7-46c4-b666-9fdf5212492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.859023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f3f834f7-58f7-46c4-b666-9fdf5212492c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:35.860250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f3f834f7-58f7-46c4-b666-9fdf5212492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:35.908497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:35.942817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ae632-3698-4780-aec1-0c72e53d2a19 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:35.949988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 458/913] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:35.964604 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330acd0e-4a0f-4b05-9b93-0aa60adc5a26 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.964895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330acd0e-4a0f-4b05-9b93-0aa60adc5a26 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.965180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330acd0e-4a0f-4b05-9b93-0aa60adc5a26 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.967070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 459/914] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:35.972230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba917d5-879f-4d60-961e-2b64d71c58a9 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.972521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba917d5-879f-4d60-961e-2b64d71c58a9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.972804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba917d5-879f-4d60-961e-2b64d71c58a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.984758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a6c53-e643-4e75-ac8e-b06419ea47a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:35.985633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6c53-e643-4e75-ac8e-b06419ea47a2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.985921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6c53-e643-4e75-ac8e-b06419ea47a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.986715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6c53-e643-4e75-ac8e-b06419ea47a2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.987368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a6c53-e643-4e75-ac8e-b06419ea47a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:35.988813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a6c53-e643-4e75-ac8e-b06419ea47a2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:35.989646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6ba917d5-879f-4d60-961e-2b64d71c58a9 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:35.990813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6ba917d5-879f-4d60-961e-2b64d71c58a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-729a6c53-e643-4e75-ac8e-b06419ea47a2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:36.001162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:36.002182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:36.003025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 456/915] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Jun 16 00:12:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:36.003869 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a6c53-e643-4e75-ac8e-b06419ea47a2 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:36.068649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 460/916] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:36.069497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba917d5-879f-4d60-961e-2b64d71c58a9 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:36.084533 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:36.121979 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a6c53-e643-4e75-ac8e-b06419ea47a2 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:36.140398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:36.159109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b559cce-ee73-4fb4-aad2-c60d0877fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:36.160129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b559cce-ee73-4fb4-aad2-c60d0877fa3d None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.160525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b559cce-ee73-4fb4-aad2-c60d0877fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.160776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b559cce-ee73-4fb4-aad2-c60d0877fa3d None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.161434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b559cce-ee73-4fb4-aad2-c60d0877fa3d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:36.162818 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b559cce-ee73-4fb4-aad2-c60d0877fa3d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:36.180005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 457/917] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:12:36 2022] POST /identity/v3/services => generated 241 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:36.180372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b559cce-ee73-4fb4-aad2-c60d0877fa3d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:36.191942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba917d5-879f-4d60-961e-2b64d71c58a9 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:36.252115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5673dd-4930-48db-b4e6-5fea73e6edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:36.253124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5673dd-4930-48db-b4e6-5fea73e6edd5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.253651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5673dd-4930-48db-b4e6-5fea73e6edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.254126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5673dd-4930-48db-b4e6-5fea73e6edd5 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.255842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5673dd-4930-48db-b4e6-5fea73e6edd5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:36.256682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5673dd-4930-48db-b4e6-5fea73e6edd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:36.259140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5673dd-4930-48db-b4e6-5fea73e6edd5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:36.272862 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 461/918] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 16 00:12:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:36.275510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5673dd-4930-48db-b4e6-5fea73e6edd5 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:36.316843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b559cce-ee73-4fb4-aad2-c60d0877fa3d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:36.367055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c98fa6-1c6e-492e-8b12-2be4f49f9962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:36.368668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c98fa6-1c6e-492e-8b12-2be4f49f9962 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.368855 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c98fa6-1c6e-492e-8b12-2be4f49f9962 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.369152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c98fa6-1c6e-492e-8b12-2be4f49f9962 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.369641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:36.369817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c98fa6-1c6e-492e-8b12-2be4f49f9962 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:36.371166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c98fa6-1c6e-492e-8b12-2be4f49f9962 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-23c98fa6-1c6e-492e-8b12-2be4f49f9962 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:36.385722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:36.386948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:36.387810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 458/919] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:36.392777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c98fa6-1c6e-492e-8b12-2be4f49f9962 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:36.417920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5673dd-4930-48db-b4e6-5fea73e6edd5 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:36.447461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:36.465941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe4ce3-6033-443a-a40f-7595fbb2f100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:36.467206 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe4ce3-6033-443a-a40f-7595fbb2f100 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.468016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe4ce3-6033-443a-a40f-7595fbb2f100 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.468910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe4ce3-6033-443a-a40f-7595fbb2f100 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.470126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe4ce3-6033-443a-a40f-7595fbb2f100 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:36.471179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe4ce3-6033-443a-a40f-7595fbb2f100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:36.473815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe4ce3-6033-443a-a40f-7595fbb2f100 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:36.481827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 462/920] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 16 00:12:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:36.487082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe4ce3-6033-443a-a40f-7595fbb2f100 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:36.520774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c98fa6-1c6e-492e-8b12-2be4f49f9962 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:36.558976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdec0f6-b0e0-44f5-bdef-b1ae2bc9adc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:36.560112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdec0f6-b0e0-44f5-bdef-b1ae2bc9adc0 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.560626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdec0f6-b0e0-44f5-bdef-b1ae2bc9adc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.561171 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdec0f6-b0e0-44f5-bdef-b1ae2bc9adc0 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.562198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdec0f6-b0e0-44f5-bdef-b1ae2bc9adc0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:36.562766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdec0f6-b0e0-44f5-bdef-b1ae2bc9adc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:36.564976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdec0f6-b0e0-44f5-bdef-b1ae2bc9adc0 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:36.575272 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 459/921] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:36.576600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdec0f6-b0e0-44f5-bdef-b1ae2bc9adc0 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:36.593831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe4ce3-6033-443a-a40f-7595fbb2f100 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:36.634913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cf2ab-1973-4ee1-8136-8361c3507c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:36.635589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cf2ab-1973-4ee1-8136-8361c3507c2a None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.635876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cf2ab-1973-4ee1-8136-8361c3507c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.636193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cf2ab-1973-4ee1-8136-8361c3507c2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.636953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cf2ab-1973-4ee1-8136-8361c3507c2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:36.638351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cf2ab-1973-4ee1-8136-8361c3507c2a None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:36.641980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:36.672076 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 463/922] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 16 00:12:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:36.703773 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdec0f6-b0e0-44f5-bdef-b1ae2bc9adc0 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:36.713985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:36.724234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ae88a-f87e-400f-9ebd-abc790a89ccc None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.725194 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ae88a-f87e-400f-9ebd-abc790a89ccc None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.725698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ae88a-f87e-400f-9ebd-abc790a89ccc None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.727811 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 464/923] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:36.738326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53151ece-c7ab-4f20-be7c-7bcbd0506a7e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.739107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53151ece-c7ab-4f20-be7c-7bcbd0506a7e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.739620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53151ece-c7ab-4f20-be7c-7bcbd0506a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.753575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7356c7-2218-45ec-930b-82bc89b0b36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:36.754261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7356c7-2218-45ec-930b-82bc89b0b36d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.754547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7356c7-2218-45ec-930b-82bc89b0b36d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.754833 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7356c7-2218-45ec-930b-82bc89b0b36d None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.755560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7356c7-2218-45ec-930b-82bc89b0b36d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:36.755872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7356c7-2218-45ec-930b-82bc89b0b36d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:36.757307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7356c7-2218-45ec-930b-82bc89b0b36d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:36.760608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-53151ece-c7ab-4f20-be7c-7bcbd0506a7e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:36.762181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-53151ece-c7ab-4f20-be7c-7bcbd0506a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:36.767833 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 460/924] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:36.769279 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7356c7-2218-45ec-930b-82bc89b0b36d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:36.871990 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 465/925] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:36.891337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53151ece-c7ab-4f20-be7c-7bcbd0506a7e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:36.896853 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7356c7-2218-45ec-930b-82bc89b0b36d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:36.937087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a107b4-d089-4d9a-bda9-e4f4f24cb0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:36.937768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a107b4-d089-4d9a-bda9-e4f4f24cb0dc None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.938056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a107b4-d089-4d9a-bda9-e4f4f24cb0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.938339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a107b4-d089-4d9a-bda9-e4f4f24cb0dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.939131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a107b4-d089-4d9a-bda9-e4f4f24cb0dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:36.940558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a107b4-d089-4d9a-bda9-e4f4f24cb0dc None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:36.977152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 461/926] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 16 00:12:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:37.014142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53151ece-c7ab-4f20-be7c-7bcbd0506a7e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:37.056514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:37.062934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085ccb3-4b71-4e8c-81ec-39ebf55618bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:37.064264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085ccb3-4b71-4e8c-81ec-39ebf55618bf None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:37.064630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085ccb3-4b71-4e8c-81ec-39ebf55618bf None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:37.065106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085ccb3-4b71-4e8c-81ec-39ebf55618bf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:37.079545 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085ccb3-4b71-4e8c-81ec-39ebf55618bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-c085ccb3-4b71-4e8c-81ec-39ebf55618bf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:37.089703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:37.091177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:37.092259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:37.094799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 466/927] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 16 00:12:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:37.101165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a107b4-d089-4d9a-bda9-e4f4f24cb0dc None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:37.129267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:37.212203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a107b4-d089-4d9a-bda9-e4f4f24cb0dc None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:37.249334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c38f4-093d-4ad0-8c62-a16bc5554371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:37.250013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c38f4-093d-4ad0-8c62-a16bc5554371 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:37.250297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c38f4-093d-4ad0-8c62-a16bc5554371 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:37.250574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c38f4-093d-4ad0-8c62-a16bc5554371 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:37.251324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c38f4-093d-4ad0-8c62-a16bc5554371 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:37.252191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c38f4-093d-4ad0-8c62-a16bc5554371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:37.253569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c38f4-093d-4ad0-8c62-a16bc5554371 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:37.263053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 462/928] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 16 00:12:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:37.268884 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085ccb3-4b71-4e8c-81ec-39ebf55618bf None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:37.376413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085ccb3-4b71-4e8c-81ec-39ebf55618bf None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:37.412709 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1715-468e-4545-84a1-a027659fa929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:37.413431 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1715-468e-4545-84a1-a027659fa929 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:37.413717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1715-468e-4545-84a1-a027659fa929 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:37.413997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d1715-468e-4545-84a1-a027659fa929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:37.425228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d1715-468e-4545-84a1-a027659fa929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:37.426798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d1715-468e-4545-84a1-a027659fa929 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-4d5d1715-468e-4545-84a1-a027659fa929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:37.444763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:37.445898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:37.446865 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:37.446865 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:37.446865 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:37.446865 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:37.450809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 467/929] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:37.452157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c38f4-093d-4ad0-8c62-a16bc5554371 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:37.546582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:37.564183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c38f4-093d-4ad0-8c62-a16bc5554371 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:37.600440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796139e2-25f1-40d9-b97e-abbd084c709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:37.601110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796139e2-25f1-40d9-b97e-abbd084c709b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:37.601398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796139e2-25f1-40d9-b97e-abbd084c709b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:37.601680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796139e2-25f1-40d9-b97e-abbd084c709b None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:37.602404 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796139e2-25f1-40d9-b97e-abbd084c709b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:37.602715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796139e2-25f1-40d9-b97e-abbd084c709b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:37.604100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796139e2-25f1-40d9-b97e-abbd084c709b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:37.621001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 463/930] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:37.622337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1715-468e-4545-84a1-a027659fa929 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:37.656369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:37.725601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d1715-468e-4545-84a1-a027659fa929 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:37.760341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edb771-11d8-499a-be07-c90f046ffec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:37.761170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb771-11d8-499a-be07-c90f046ffec9 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:37.761457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb771-11d8-499a-be07-c90f046ffec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:37.761738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb771-11d8-499a-be07-c90f046ffec9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:37.769740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edb771-11d8-499a-be07-c90f046ffec9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:37.771197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edb771-11d8-499a-be07-c90f046ffec9 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-93edb771-11d8-499a-be07-c90f046ffec9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:37.786527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:37.787588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:37.788600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:37.788600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:37.788600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:37.788600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:37.788600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:37.788600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:37.788600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:37.788600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:37.788600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:37.788600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:37.792122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 468/931] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 16 00:12:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:37.794215 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796139e2-25f1-40d9-b97e-abbd084c709b None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:37.899172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796139e2-25f1-40d9-b97e-abbd084c709b None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:37.936414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e9d1a-b5e4-424c-ae3b-bfafbc88dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:37.937112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e9d1a-b5e4-424c-ae3b-bfafbc88dff8 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:37.937400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e9d1a-b5e4-424c-ae3b-bfafbc88dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:37.937679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e9d1a-b5e4-424c-ae3b-bfafbc88dff8 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:37.938551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e9d1a-b5e4-424c-ae3b-bfafbc88dff8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:37.938867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e9d1a-b5e4-424c-ae3b-bfafbc88dff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:37.940906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e9d1a-b5e4-424c-ae3b-bfafbc88dff8 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:37.963796 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 464/932] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 16 00:12:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:37.965174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edb771-11d8-499a-be07-c90f046ffec9 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:38.060383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:38.081110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edb771-11d8-499a-be07-c90f046ffec9 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:38.118260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e6266-9ee6-4cce-a4b1-38cf2ee8486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:38.119439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6266-9ee6-4cce-a4b1-38cf2ee8486c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:38.119983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6266-9ee6-4cce-a4b1-38cf2ee8486c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:38.120470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6266-9ee6-4cce-a4b1-38cf2ee8486c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:38.131488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e6266-9ee6-4cce-a4b1-38cf2ee8486c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:38.133198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e6266-9ee6-4cce-a4b1-38cf2ee8486c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-ad3e6266-9ee6-4cce-a4b1-38cf2ee8486c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:38.150578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:38.151551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:38.152488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:38.152488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:38.152488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:38.152488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:38.154656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 469/933] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:38.160534 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e9d1a-b5e4-424c-ae3b-bfafbc88dff8 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:38.163324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:38.269179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e9d1a-b5e4-424c-ae3b-bfafbc88dff8 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:38.305187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e1138-c588-4c63-ab46-b1ede02bc765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:38.306246 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1138-c588-4c63-ab46-b1ede02bc765 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:38.306732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1138-c588-4c63-ab46-b1ede02bc765 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:38.307208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e1138-c588-4c63-ab46-b1ede02bc765 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:38.308229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e1138-c588-4c63-ab46-b1ede02bc765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:38.308766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e1138-c588-4c63-ab46-b1ede02bc765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:38.310420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e1138-c588-4c63-ab46-b1ede02bc765 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:38.329158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 465/934] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:38.331454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e6266-9ee6-4cce-a4b1-38cf2ee8486c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:38.380574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001e10a-1502-4f8b-88d6-5b6447305930 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:38.381189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001e10a-1502-4f8b-88d6-5b6447305930 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:38.381676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001e10a-1502-4f8b-88d6-5b6447305930 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:38.383600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 466/935] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:38.388036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466981e-e336-43e9-aa4e-8176fa1cd58a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:38.388551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466981e-e336-43e9-aa4e-8176fa1cd58a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:38.389043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466981e-e336-43e9-aa4e-8176fa1cd58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:38.408409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2466981e-e336-43e9-aa4e-8176fa1cd58a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:38.409591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2466981e-e336-43e9-aa4e-8176fa1cd58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:38.444314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e6266-9ee6-4cce-a4b1-38cf2ee8486c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:38.470703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:38.482699 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde76c5-13fd-425d-8f1d-4d8895b92c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:38.483561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 467/936] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:38.484022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde76c5-13fd-425d-8f1d-4d8895b92c3c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:38.484535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde76c5-13fd-425d-8f1d-4d8895b92c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:38.485019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde76c5-13fd-425d-8f1d-4d8895b92c3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:38.492882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde76c5-13fd-425d-8f1d-4d8895b92c3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:38.494581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dde76c5-13fd-425d-8f1d-4d8895b92c3c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:38.497367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:38.506718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466981e-e336-43e9-aa4e-8176fa1cd58a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-1dde76c5-13fd-425d-8f1d-4d8895b92c3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:38.511087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:38.511982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:38.512886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:38.512886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:38.512886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:38.512886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:38.512886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:38.512886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:38.512886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:38.512886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:38.512886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 470/937] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:38.521227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde76c5-13fd-425d-8f1d-4d8895b92c3c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:38.618536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466981e-e336-43e9-aa4e-8176fa1cd58a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:38.634515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde76c5-13fd-425d-8f1d-4d8895b92c3c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:38.657417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d9d5b-fa65-4f85-b070-004d048e71bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:38.658267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d9d5b-fa65-4f85-b070-004d048e71bc None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:38.658550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d9d5b-fa65-4f85-b070-004d048e71bc None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:38.658828 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d9d5b-fa65-4f85-b070-004d048e71bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:38.660059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d9d5b-fa65-4f85-b070-004d048e71bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:38.661710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d9d5b-fa65-4f85-b070-004d048e71bc None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:38.674235 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650984d-30fe-445c-bc7e-a2681788c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:38.675030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650984d-30fe-445c-bc7e-a2681788c6db None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:38.675422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650984d-30fe-445c-bc7e-a2681788c6db None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:38.675824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650984d-30fe-445c-bc7e-a2681788c6db None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:38.676804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650984d-30fe-445c-bc7e-a2681788c6db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-7e8d9d5b-fa65-4f85-b070-004d048e71bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:38.677092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:38.678849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:38.679893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:38.680671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650984d-30fe-445c-bc7e-a2681788c6db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:38.680742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 468/938] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 16 00:12:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:38.680809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650984d-30fe-445c-bc7e-a2681788c6db None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:38.685878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d9d5b-fa65-4f85-b070-004d048e71bc None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:38.701568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 471/939] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:38.702876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650984d-30fe-445c-bc7e-a2681788c6db None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:38.743882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:38.772954 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:38.793763 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d9d5b-fa65-4f85-b070-004d048e71bc None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:38.820970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650984d-30fe-445c-bc7e-a2681788c6db None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:38.831978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c71422-a810-442c-979f-0befaf870e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:38.832916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c71422-a810-442c-979f-0befaf870e56 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:38.833199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c71422-a810-442c-979f-0befaf870e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:38.833475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c71422-a810-442c-979f-0befaf870e56 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:38.834175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c71422-a810-442c-979f-0befaf870e56 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:38.834480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c71422-a810-442c-979f-0befaf870e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:38.836085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c71422-a810-442c-979f-0befaf870e56 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:38.846613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 469/940] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 16 00:12:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:38.847857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c71422-a810-442c-979f-0befaf870e56 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:38.857834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ad2b8-3fc5-4c70-b61b-4e8744e66a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:38.858777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ad2b8-3fc5-4c70-b61b-4e8744e66a6c None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:38.859095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ad2b8-3fc5-4c70-b61b-4e8744e66a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:38.859445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ad2b8-3fc5-4c70-b61b-4e8744e66a6c None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/1fc6d76795694d91b41b8bf819728aae/roles/ae85f17673084352ab9b3953669ab67e` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:38.861860 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ad2b8-3fc5-4c70-b61b-4e8744e66a6c None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=1fc6d76795694d91b41b8bf819728aae, role_id=ae85f17673084352ab9b3953669ab67e)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:38.863494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ad2b8-3fc5-4c70-b61b-4e8744e66a6c None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:38.884831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 472/941] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:12:38 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/1fc6d76795694d91b41b8bf819728aae/roles/ae85f17673084352ab9b3953669ab67e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:12:38.968624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c71422-a810-442c-979f-0befaf870e56 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:38.993580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:39.012630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b0c15-899f-4a91-9caf-a0bb18611d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:39.013328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b0c15-899f-4a91-9caf-a0bb18611d58 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.013614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b0c15-899f-4a91-9caf-a0bb18611d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.026770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b0c15-899f-4a91-9caf-a0bb18611d58 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.026770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b0c15-899f-4a91-9caf-a0bb18611d58 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:39.026770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b0c15-899f-4a91-9caf-a0bb18611d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:39.026770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b0c15-899f-4a91-9caf-a0bb18611d58 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:39.028173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 470/942] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 16 00:12:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:39.030805 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ad2b8-3fc5-4c70-b61b-4e8744e66a6c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:39.073967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215afb8b-508d-4379-b4b4-fdb29aa06cd0 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.074559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215afb8b-508d-4379-b4b4-fdb29aa06cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.074838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215afb8b-508d-4379-b4b4-fdb29aa06cd0 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.076538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 471/943] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:39.085431 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3bf2f-32a8-4eee-8d7f-13f6640c5815 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.085720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3bf2f-32a8-4eee-8d7f-13f6640c5815 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.086003 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3bf2f-32a8-4eee-8d7f-13f6640c5815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.103184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-c0f3bf2f-32a8-4eee-8d7f-13f6640c5815 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:39.104395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c0f3bf2f-32a8-4eee-8d7f-13f6640c5815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:39.152308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ad2b8-3fc5-4c70-b61b-4e8744e66a6c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:39.173225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:39.191484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb217f-27b6-4120-8182-d32db0c8011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:39.192261 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb217f-27b6-4120-8182-d32db0c8011b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.192584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb217f-27b6-4120-8182-d32db0c8011b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.192867 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb217f-27b6-4120-8182-d32db0c8011b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.193717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb217f-27b6-4120-8182-d32db0c8011b None admin] RBAC: Adding query filter params (interface=public, service_id=9cc90dd8bd724fbc92e36a900b1f34ed, region_id=RegionOne) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:39.194038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb217f-27b6-4120-8182-d32db0c8011b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:39.195006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 472/944] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:39.195472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb217f-27b6-4120-8182-d32db0c8011b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:39.205401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 473/945] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 16 00:12:39 2022] GET /identity/v3/endpoints?service_id=9cc90dd8bd724fbc92e36a900b1f34ed&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:39.211019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3bf2f-32a8-4eee-8d7f-13f6640c5815 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:39.217145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb217f-27b6-4120-8182-d32db0c8011b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:39.327105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb217f-27b6-4120-8182-d32db0c8011b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:39.333709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3bf2f-32a8-4eee-8d7f-13f6640c5815 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:39.349148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:39.365548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9b3d4-6ac5-4dac-b311-4f1d91954290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:39.366508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b3d4-6ac5-4dac-b311-4f1d91954290 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.366825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b3d4-6ac5-4dac-b311-4f1d91954290 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.367415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b3d4-6ac5-4dac-b311-4f1d91954290 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.368448 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9b3d4-6ac5-4dac-b311-4f1d91954290 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:39.370110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9b3d4-6ac5-4dac-b311-4f1d91954290 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:39.371695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95bda-c7d0-4a52-90c5-41d54a9fd446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:39.372395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95bda-c7d0-4a52-90c5-41d54a9fd446 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.372680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95bda-c7d0-4a52-90c5-41d54a9fd446 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.372965 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95bda-c7d0-4a52-90c5-41d54a9fd446 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.373640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95bda-c7d0-4a52-90c5-41d54a9fd446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:39.374991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95bda-c7d0-4a52-90c5-41d54a9fd446 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:39.388014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 473/946] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 16 00:12:39 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:12:39.388014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a83040-616c-4557-b3ae-8e21f17cef14 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.388014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a83040-616c-4557-b3ae-8e21f17cef14 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.388014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a83040-616c-4557-b3ae-8e21f17cef14 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-4aa9b3d4-6ac5-4dac-b311-4f1d91954290 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:39.388414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:39.389327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:12:39.390165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:39.390913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 474/947] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:39.390991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 474/948] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:39.391425 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a83040-616c-4557-b3ae-8e21f17cef14 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:39.398125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2960f2e-020f-4bd5-aa90-70153b9d2e14 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.398464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2960f2e-020f-4bd5-aa90-70153b9d2e14 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.398819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2960f2e-020f-4bd5-aa90-70153b9d2e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.422059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b2960f2e-020f-4bd5-aa90-70153b9d2e14 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:39.423377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b2960f2e-020f-4bd5-aa90-70153b9d2e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:39.473561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:39.511611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 475/949] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:39.521813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a83040-616c-4557-b3ae-8e21f17cef14 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:39.536686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2960f2e-020f-4bd5-aa90-70153b9d2e14 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:39.562903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a851-9de1-46aa-b666-6014b79de1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:39.564107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a851-9de1-46aa-b666-6014b79de1ad None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.564631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a851-9de1-46aa-b666-6014b79de1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.565116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a851-9de1-46aa-b666-6014b79de1ad None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.566074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80a851-9de1-46aa-b666-6014b79de1ad None admin] RBAC: Adding query filter params (name=compute) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:39.566688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80a851-9de1-46aa-b666-6014b79de1ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:39.568436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80a851-9de1-46aa-b666-6014b79de1ad None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:39.574621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 475/950] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:39.580991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a851-9de1-46aa-b666-6014b79de1ad None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:39.633938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:39.674775 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2960f2e-020f-4bd5-aa90-70153b9d2e14 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:39.699696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a851-9de1-46aa-b666-6014b79de1ad None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:39.718439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ee9f2-3ce3-493b-ad73-d78b3b8ea2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:39.719113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ee9f2-3ce3-493b-ad73-d78b3b8ea2f8 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.719409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ee9f2-3ce3-493b-ad73-d78b3b8ea2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.719685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ee9f2-3ce3-493b-ad73-d78b3b8ea2f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.720490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ee9f2-3ce3-493b-ad73-d78b3b8ea2f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:39.721950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ee9f2-3ce3-493b-ad73-d78b3b8ea2f8 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:39.723329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: WARNING keystone.server.flask.common [None req-829ee9f2-3ce3-493b-ad73-d78b3b8ea2f8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 00:12:39.740190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f013-ac78-4b28-b294-b07b91321e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:39.741375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f013-ac78-4b28-b294-b07b91321e11 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.741769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f013-ac78-4b28-b294-b07b91321e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.742287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f013-ac78-4b28-b294-b07b91321e11 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.743196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f013-ac78-4b28-b294-b07b91321e11 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:39.743563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f013-ac78-4b28-b294-b07b91321e11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:39.744329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.sql.core [None req-829ee9f2-3ce3-493b-ad73-d78b3b8ea2f8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:12:39.744329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 00:12:39.744329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [parameters: {'id': '02a2b671fb6f48548d7551ffd95970f8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 00:12:39.744329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81055) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:12:39.745299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005f013-ac78-4b28-b294-b07b91321e11 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:39.750845 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 476/951] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-829ee9f2-3ce3-493b-ad73-d78b3b8ea2f8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02a2b671fb6f48548d7551ffd95970f8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02a2b671fb6f48548d7551ffd95970f8. Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:12:39.763638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application result.read() Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 00:12:39.764628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application yield resource Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise self.value Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application session.commit() Jun 16 00:12:39.765611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:12:39.766517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:12:39.767416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application result.read() Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:12:39.769433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [parameters: {'id': '02a2b671fb6f48548d7551ffd95970f8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:39.771330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:39.773625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:39.777372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:39.777372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 00:12:39.777372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 00:12:39.777372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:39.777372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:39.777372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 00:12:39.777372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 00:12:39.777372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02a2b671fb6f48548d7551ffd95970f8. Jun 16 00:12:39.777372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:39.778982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 476/952] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Jun 16 00:12:39 2022] POST /identity/v3/projects => generated 262 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:39.783722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f013-ac78-4b28-b294-b07b91321e11 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:39.899597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f013-ac78-4b28-b294-b07b91321e11 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:39.909036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:39.941975 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7afd4d-065f-4aa6-8e62-2267e5657100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:39.943006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7afd4d-065f-4aa6-8e62-2267e5657100 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:39.943437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7afd4d-065f-4aa6-8e62-2267e5657100 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:39.943877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7afd4d-065f-4aa6-8e62-2267e5657100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:39.951170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7afd4d-065f-4aa6-8e62-2267e5657100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:39.952820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7afd4d-065f-4aa6-8e62-2267e5657100 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-4d7afd4d-065f-4aa6-8e62-2267e5657100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:39.967436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:39.968738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:39.969890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:39.969890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:39.969890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:39.969890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:39.969890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:39.969890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:39.969890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:39.969890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:39.972126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 477/953] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:39.977797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ee9f2-3ce3-493b-ad73-d78b3b8ea2f8 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:40.025447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:40.103751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ee9f2-3ce3-493b-ad73-d78b3b8ea2f8 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:40.139187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15419926-533b-43fd-938f-072fc544bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:40.139859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419926-533b-43fd-938f-072fc544bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:40.140177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419926-533b-43fd-938f-072fc544bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:40.140459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419926-533b-43fd-938f-072fc544bcd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:40.141230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15419926-533b-43fd-938f-072fc544bcd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:40.141545 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15419926-533b-43fd-938f-072fc544bcd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:40.143997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15419926-533b-43fd-938f-072fc544bcd3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:40.164599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 477/954] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:41.101997 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bbd81-d791-43d4-8665-f2865989abfa None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.102645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bbd81-d791-43d4-8665-f2865989abfa None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.102645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bbd81-d791-43d4-8665-f2865989abfa None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.104167 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 478/955] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:41.109459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f16bfc-9429-47d0-bfbc-0194b97c073b None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.109932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f16bfc-9429-47d0-bfbc-0194b97c073b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.110097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f16bfc-9429-47d0-bfbc-0194b97c073b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.129191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-14f16bfc-9429-47d0-bfbc-0194b97c073b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:41.130691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-14f16bfc-9429-47d0-bfbc-0194b97c073b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:41.199114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 478/956] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:41.223211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bbd81-d791-43d4-8665-f2865989abfa None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:41.333092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bbd81-d791-43d4-8665-f2865989abfa None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:41.368327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f512429-3c4d-4c35-b22a-f16a7a5b7c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:41.369517 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f512429-3c4d-4c35-b22a-f16a7a5b7c01 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.370108 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f512429-3c4d-4c35-b22a-f16a7a5b7c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.370604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f512429-3c4d-4c35-b22a-f16a7a5b7c01 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.382248 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f512429-3c4d-4c35-b22a-f16a7a5b7c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-5f512429-3c4d-4c35-b22a-f16a7a5b7c01 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:41.390846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:41.391820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:41.393986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:41.396445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 479/957] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 16 00:12:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:41.402149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f16bfc-9429-47d0-bfbc-0194b97c073b None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:41.428553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:41.511609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f16bfc-9429-47d0-bfbc-0194b97c073b None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:41.547035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a0ae-3e62-497f-9042-1cf6b58de4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:41.547718 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a0ae-3e62-497f-9042-1cf6b58de4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.548030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a0ae-3e62-497f-9042-1cf6b58de4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.548842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a0ae-3e62-497f-9042-1cf6b58de4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.549606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a0ae-3e62-497f-9042-1cf6b58de4a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:41.549921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a0ae-3e62-497f-9042-1cf6b58de4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:41.551296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a0ae-3e62-497f-9042-1cf6b58de4a7 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:41.560345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 479/958] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 16 00:12:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:41.566175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f512429-3c4d-4c35-b22a-f16a7a5b7c01 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:41.596923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:41.667797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f512429-3c4d-4c35-b22a-f16a7a5b7c01 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:41.705968 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd69fc-09d4-4079-a6c9-66f10d716095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:41.706793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd69fc-09d4-4079-a6c9-66f10d716095 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.707081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd69fc-09d4-4079-a6c9-66f10d716095 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.707357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd69fc-09d4-4079-a6c9-66f10d716095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.718677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd69fc-09d4-4079-a6c9-66f10d716095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:41.720744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd69fc-09d4-4079-a6c9-66f10d716095 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-07cd69fc-09d4-4079-a6c9-66f10d716095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:41.738392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:41.739293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:41.740224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:41.740224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:41.740224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:41.740224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:41.740224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 480/959] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:41.746001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a0ae-3e62-497f-9042-1cf6b58de4a7 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:41.750491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035172e4-b4bf-47a2-b1a8-81139de84e88 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.750785 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035172e4-b4bf-47a2-b1a8-81139de84e88 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.751067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035172e4-b4bf-47a2-b1a8-81139de84e88 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.753291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 481/960] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:41.760291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5df7d0-5c4b-4477-b6a8-56a77de3957a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.760584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5df7d0-5c4b-4477-b6a8-56a77de3957a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.760869 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5df7d0-5c4b-4477-b6a8-56a77de3957a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.781011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-bc5df7d0-5c4b-4477-b6a8-56a77de3957a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:41.782205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-bc5df7d0-5c4b-4477-b6a8-56a77de3957a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:41.856085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:41.874464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a0ae-3e62-497f-9042-1cf6b58de4a7 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:41.886067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 482/961] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:41.909610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5df7d0-5c4b-4477-b6a8-56a77de3957a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:41.916655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af90e77-95ce-4c81-8306-6b7e8d09f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:41.917752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af90e77-95ce-4c81-8306-6b7e8d09f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.919030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af90e77-95ce-4c81-8306-6b7e8d09f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.919561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af90e77-95ce-4c81-8306-6b7e8d09f7b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.921199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:41.922381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af90e77-95ce-4c81-8306-6b7e8d09f7b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:41.923767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af90e77-95ce-4c81-8306-6b7e8d09f7b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:41.926516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af90e77-95ce-4c81-8306-6b7e8d09f7b1 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:41.946185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 480/962] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:41.951420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af90e77-95ce-4c81-8306-6b7e8d09f7b1 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.037176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5df7d0-5c4b-4477-b6a8-56a77de3957a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.063503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af90e77-95ce-4c81-8306-6b7e8d09f7b1 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.072142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3421b9c-ccb1-4d56-a476-c1acbb5afeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.073503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3421b9c-ccb1-4d56-a476-c1acbb5afeda None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.074251 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3421b9c-ccb1-4d56-a476-c1acbb5afeda None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.074685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3421b9c-ccb1-4d56-a476-c1acbb5afeda None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.075634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3421b9c-ccb1-4d56-a476-c1acbb5afeda None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.077176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3421b9c-ccb1-4d56-a476-c1acbb5afeda None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-d3421b9c-ccb1-4d56-a476-c1acbb5afeda None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:42.089915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:42.091436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:42.092524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:42.094964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 483/963] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 16 00:12:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:42.096297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750e3ba-6e6e-41ff-9a95-09140dec01f9 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.096590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750e3ba-6e6e-41ff-9a95-09140dec01f9 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.096872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750e3ba-6e6e-41ff-9a95-09140dec01f9 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.098299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 484/964] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:42.102796 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750e3ba-6e6e-41ff-9a95-09140dec01f9 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.104114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0511726-582f-4ddc-bb5d-8c09030a8b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.104942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511726-582f-4ddc-bb5d-8c09030a8b76 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.105232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511726-582f-4ddc-bb5d-8c09030a8b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.105510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511726-582f-4ddc-bb5d-8c09030a8b76 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.114145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0511726-582f-4ddc-bb5d-8c09030a8b76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.115531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0511726-582f-4ddc-bb5d-8c09030a8b76 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-f0511726-582f-4ddc-bb5d-8c09030a8b76 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:42.130970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:42.131906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:42.132905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:42.132905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:42.132905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:42.132905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:42.132905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:42.132905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:42.132905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:42.132905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:42.132905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:12:42.132905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:42.136917 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 481/965] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 16 00:12:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:42.138459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4b8c8-66b2-4ba7-8568-370e43d0b9cc None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.138761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4b8c8-66b2-4ba7-8568-370e43d0b9cc None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.139044 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4b8c8-66b2-4ba7-8568-370e43d0b9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.149822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.157181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-9bd4b8c8-66b2-4ba7-8568-370e43d0b9cc None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:42.158432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9bd4b8c8-66b2-4ba7-8568-370e43d0b9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:42.183060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.218305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750e3ba-6e6e-41ff-9a95-09140dec01f9 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.236232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 482/966] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:42.236232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4b8c8-66b2-4ba7-8568-370e43d0b9cc None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.271694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730edf22-5262-40b5-b9c3-f0af60b4a281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.272404 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730edf22-5262-40b5-b9c3-f0af60b4a281 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.272717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730edf22-5262-40b5-b9c3-f0af60b4a281 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.272966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730edf22-5262-40b5-b9c3-f0af60b4a281 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.273668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730edf22-5262-40b5-b9c3-f0af60b4a281 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:42.273977 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730edf22-5262-40b5-b9c3-f0af60b4a281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.275334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730edf22-5262-40b5-b9c3-f0af60b4a281 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.280537 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 485/967] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:42.285735 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730edf22-5262-40b5-b9c3-f0af60b4a281 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.345908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4b8c8-66b2-4ba7-8568-370e43d0b9cc None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.383531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef53ec9-cfac-4657-81da-2615e288d149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.384153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef53ec9-cfac-4657-81da-2615e288d149 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.384447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef53ec9-cfac-4657-81da-2615e288d149 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.384725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef53ec9-cfac-4657-81da-2615e288d149 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.385562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef53ec9-cfac-4657-81da-2615e288d149 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:42.385961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef53ec9-cfac-4657-81da-2615e288d149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.387391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef53ec9-cfac-4657-81da-2615e288d149 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.390073 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.394684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730edf22-5262-40b5-b9c3-f0af60b4a281 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.405498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 483/968] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:42.406386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef53ec9-cfac-4657-81da-2615e288d149 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.431200 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d43b56-ee57-4b66-a7f4-5506c64f1a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.431660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43b56-ee57-4b66-a7f4-5506c64f1a09 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.431951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43b56-ee57-4b66-a7f4-5506c64f1a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.432265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d43b56-ee57-4b66-a7f4-5506c64f1a09 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.432986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d43b56-ee57-4b66-a7f4-5506c64f1a09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.434354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d43b56-ee57-4b66-a7f4-5506c64f1a09 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.437225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.449207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 486/969] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:12:42 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:42.450464 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23876d-add8-4112-9a4c-82686dc48768 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.450757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23876d-add8-4112-9a4c-82686dc48768 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.451042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23876d-add8-4112-9a4c-82686dc48768 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.452295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 487/970] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:42.453009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23876d-add8-4112-9a4c-82686dc48768 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.527066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef53ec9-cfac-4657-81da-2615e288d149 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.571047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d9ee1-b6d7-49d7-b71b-712486909096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.571735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9ee1-b6d7-49d7-b71b-712486909096 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.572050 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9ee1-b6d7-49d7-b71b-712486909096 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.572333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d9ee1-b6d7-49d7-b71b-712486909096 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.573048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d9ee1-b6d7-49d7-b71b-712486909096 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:42.573364 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d9ee1-b6d7-49d7-b71b-712486909096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.574781 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d9ee1-b6d7-49d7-b71b-712486909096 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.580495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 484/971] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:42.581799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8467-7435-4b23-8539-acf1ebbce683 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.582096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8467-7435-4b23-8539-acf1ebbce683 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.582379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8467-7435-4b23-8539-acf1ebbce683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.600223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4b5f8467-7435-4b23-8539-acf1ebbce683 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:42.601188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23876d-add8-4112-9a4c-82686dc48768 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.601449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4b5f8467-7435-4b23-8539-acf1ebbce683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:42.640364 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87b283-39c4-4c13-a972-bac84a3dab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.642879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b283-39c4-4c13-a972-bac84a3dab0d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.642879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b283-39c4-4c13-a972-bac84a3dab0d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.642879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b283-39c4-4c13-a972-bac84a3dab0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.667735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.686404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 485/972] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:42.687307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f8467-7435-4b23-8539-acf1ebbce683 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.721956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.729996 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87b283-39c4-4c13-a972-bac84a3dab0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.731680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87b283-39c4-4c13-a972-bac84a3dab0d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.801799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f8467-7435-4b23-8539-acf1ebbce683 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.842211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c76b1-710d-47fc-a925-4823202a101b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.846998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 488/973] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:12:42.847128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c76b1-710d-47fc-a925-4823202a101b None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.847128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c76b1-710d-47fc-a925-4823202a101b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.847128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c76b1-710d-47fc-a925-4823202a101b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.847342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87b283-39c4-4c13-a972-bac84a3dab0d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.847411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c76b1-710d-47fc-a925-4823202a101b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.847411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c76b1-710d-47fc-a925-4823202a101b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.875999 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 486/974] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 16 00:12:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:42.875999 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c76b1-710d-47fc-a925-4823202a101b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.945738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.972685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.980916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87b283-39c4-4c13-a972-bac84a3dab0d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.032391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9154a5-b37f-4696-86a5-37663c70b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.033353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9154a5-b37f-4696-86a5-37663c70b154 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.034057 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9154a5-b37f-4696-86a5-37663c70b154 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.034347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9154a5-b37f-4696-86a5-37663c70b154 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.035065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9154a5-b37f-4696-86a5-37663c70b154 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.036784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9154a5-b37f-4696-86a5-37663c70b154 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.039118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: WARNING keystone.server.flask.common [None req-0a9154a5-b37f-4696-86a5-37663c70b154 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 00:12:43.053641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c76b1-710d-47fc-a925-4823202a101b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.055360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.sql.core [None req-0a9154a5-b37f-4696-86a5-37663c70b154 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:12:43.055360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 00:12:43.055360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [parameters: {'user_id': 'e5a39f5be13f45279cf34863c106d133', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 00:12:43.055360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81054) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-0a9154a5-b37f-4696-86a5-37663c70b154 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application result.read() Jun 16 00:12:43.063436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:12:43.064934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application yield resource Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise self.value Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application session.commit() Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:12:43.066161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:12:43.067244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:12:43.068162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application result.read() Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:12:43.069014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e5a39f5be13f45279cf34863c106d133', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:43.077016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 00:12:43.078847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 00:12:43.082290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 00:12:43.082290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 00:12:43.082290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:12:43.082290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:12:43.082290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 00:12:43.082290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:43.082290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 489/975] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jun 16 00:12:42 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:43.082290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9154a5-b37f-4696-86a5-37663c70b154 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.099551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0198b-c3d7-4e3f-b474-3458c66e83c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.100503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0198b-c3d7-4e3f-b474-3458c66e83c5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.100785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0198b-c3d7-4e3f-b474-3458c66e83c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.101060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0198b-c3d7-4e3f-b474-3458c66e83c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.114963 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0198b-c3d7-4e3f-b474-3458c66e83c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.117231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0198b-c3d7-4e3f-b474-3458c66e83c5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-64f0198b-c3d7-4e3f-b474-3458c66e83c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:43.137606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:43.138573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:43.139660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:43.139660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:43.139660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:43.139660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:43.139660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 487/976] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:43.144734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0198b-c3d7-4e3f-b474-3458c66e83c5 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.201167 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9154a5-b37f-4696-86a5-37663c70b154 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.237153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e38b8-7993-4297-8171-8202b6aa2278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.238197 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e38b8-7993-4297-8171-8202b6aa2278 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.238760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e38b8-7993-4297-8171-8202b6aa2278 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.239185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e38b8-7993-4297-8171-8202b6aa2278 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.248739 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e38b8-7993-4297-8171-8202b6aa2278 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.250583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e38b8-7993-4297-8171-8202b6aa2278 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.261262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-7d4e38b8-7993-4297-8171-8202b6aa2278 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:43.266041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:43.267310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:43.268485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:43.268485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:43.268485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:43.268485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:43.268485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:43.268485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:43.268485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:43.268485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:43.268485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:12:43.268485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:43.272078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 490/977] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:43.273321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e38b8-7993-4297-8171-8202b6aa2278 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.275607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0198b-c3d7-4e3f-b474-3458c66e83c5 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.293320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.313716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e7993-5c98-432a-bf86-5a0d354c5767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.315021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7993-5c98-432a-bf86-5a0d354c5767 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.315367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7993-5c98-432a-bf86-5a0d354c5767 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.315824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7993-5c98-432a-bf86-5a0d354c5767 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.317404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7993-5c98-432a-bf86-5a0d354c5767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:43.317404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7993-5c98-432a-bf86-5a0d354c5767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.318557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7993-5c98-432a-bf86-5a0d354c5767 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.335688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 488/978] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:43.337627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e7993-5c98-432a-bf86-5a0d354c5767 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.395006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e38b8-7993-4297-8171-8202b6aa2278 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.433235 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a2426-0836-4a2e-adc5-8a6b5fc11dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.434377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2426-0836-4a2e-adc5-8a6b5fc11dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.434860 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2426-0836-4a2e-adc5-8a6b5fc11dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.435333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2426-0836-4a2e-adc5-8a6b5fc11dd2 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.436361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a2426-0836-4a2e-adc5-8a6b5fc11dd2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:43.436965 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a2426-0836-4a2e-adc5-8a6b5fc11dd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.438828 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a2426-0836-4a2e-adc5-8a6b5fc11dd2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.452764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e7993-5c98-432a-bf86-5a0d354c5767 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.481218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 491/979] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:43.494509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304c103-0df1-454f-ad17-e739dfd63a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.495332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c103-0df1-454f-ad17-e739dfd63a07 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.495616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c103-0df1-454f-ad17-e739dfd63a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.495897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304c103-0df1-454f-ad17-e739dfd63a07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.504403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304c103-0df1-454f-ad17-e739dfd63a07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.505894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304c103-0df1-454f-ad17-e739dfd63a07 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-e304c103-0df1-454f-ad17-e739dfd63a07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:43.521960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:43.522904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:43.523808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:43.523808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:43.523808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:43.523808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:43.523808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:43.523808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:43.523808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:43.523808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:43.523808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 489/980] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:43.530724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a2426-0836-4a2e-adc5-8a6b5fc11dd2 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.611943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.645236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a2426-0836-4a2e-adc5-8a6b5fc11dd2 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.681737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9698a-c260-4d05-9ae9-e8ba46efc6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.682471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9698a-c260-4d05-9ae9-e8ba46efc6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.682761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9698a-c260-4d05-9ae9-e8ba46efc6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.683038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9698a-c260-4d05-9ae9-e8ba46efc6c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.683828 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9698a-c260-4d05-9ae9-e8ba46efc6c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:43.684197 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9698a-c260-4d05-9ae9-e8ba46efc6c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.685625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9698a-c260-4d05-9ae9-e8ba46efc6c4 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.699671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 492/981] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:43.706533 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304c103-0df1-454f-ad17-e739dfd63a07 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.726853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.820151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304c103-0df1-454f-ad17-e739dfd63a07 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.854623 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45ae30-9951-4ed2-ac7b-300a6b4ee9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.855521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ae30-9951-4ed2-ac7b-300a6b4ee9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.856004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ae30-9951-4ed2-ac7b-300a6b4ee9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.856460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45ae30-9951-4ed2-ac7b-300a6b4ee9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.857450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45ae30-9951-4ed2-ac7b-300a6b4ee9f4 None admin] RBAC: Adding query filter params (role.id=ae85f17673084352ab9b3953669ab67e, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=1fc6d76795694d91b41b8bf819728aae) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:43.857959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45ae30-9951-4ed2-ac7b-300a6b4ee9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.859545 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45ae30-9951-4ed2-ac7b-300a6b4ee9f4 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.865538 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 490/982] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/role_assignments?user.id=1fc6d76795694d91b41b8bf819728aae&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=ae85f17673084352ab9b3953669ab67e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:44.609692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfee62-23d0-4a6b-a239-4c9b6d1c5274 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:44.610253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfee62-23d0-4a6b-a239-4c9b6d1c5274 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:44.610253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfee62-23d0-4a6b-a239-4c9b6d1c5274 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:44.612331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 493/983] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:44.617267 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71082d06-78a0-4290-bc85-4b5ef95e53db None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:44.617655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71082d06-78a0-4290-bc85-4b5ef95e53db None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:44.617839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71082d06-78a0-4290-bc85-4b5ef95e53db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:44.634748 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-71082d06-78a0-4290-bc85-4b5ef95e53db None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:44.635935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-71082d06-78a0-4290-bc85-4b5ef95e53db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:44.705856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 491/984] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:44.727696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfee62-23d0-4a6b-a239-4c9b6d1c5274 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:44.831297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfee62-23d0-4a6b-a239-4c9b6d1c5274 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:44.860838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:44.866770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d94f-5d21-4f2e-8170-54017bd02b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:44.867565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d94f-5d21-4f2e-8170-54017bd02b56 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:44.867850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d94f-5d21-4f2e-8170-54017bd02b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:44.868151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d94f-5d21-4f2e-8170-54017bd02b56 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:44.868806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3d94f-5d21-4f2e-8170-54017bd02b56 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:44.870172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3d94f-5d21-4f2e-8170-54017bd02b56 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-e5b3d94f-5d21-4f2e-8170-54017bd02b56 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:44.882432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:44.883452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:12:44.884447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:44.885883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 494/985] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:44.889666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71082d06-78a0-4290-bc85-4b5ef95e53db None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:44.898294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:44.993689 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71082d06-78a0-4290-bc85-4b5ef95e53db None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:45.037286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e40bc-8a52-4c77-aff2-cf9fefb29b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:45.037961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e40bc-8a52-4c77-aff2-cf9fefb29b4d None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:45.038248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e40bc-8a52-4c77-aff2-cf9fefb29b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:45.038524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e40bc-8a52-4c77-aff2-cf9fefb29b4d None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:45.039232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e40bc-8a52-4c77-aff2-cf9fefb29b4d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:45.039543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e40bc-8a52-4c77-aff2-cf9fefb29b4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:45.040936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e40bc-8a52-4c77-aff2-cf9fefb29b4d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:45.048145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 492/986] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:45.051717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d94f-5d21-4f2e-8170-54017bd02b56 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:45.141256 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d3863-0b54-4f72-8b4f-d65254b3b0b7 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:45.141449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d3863-0b54-4f72-8b4f-d65254b3b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:45.141711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d3863-0b54-4f72-8b4f-d65254b3b0b7 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:45.143251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 493/987] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:45.147832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27493c48-db72-46ac-a4fa-035087bc0631 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:45.148193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27493c48-db72-46ac-a4fa-035087bc0631 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:45.148480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27493c48-db72-46ac-a4fa-035087bc0631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:45.160730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d94f-5d21-4f2e-8170-54017bd02b56 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:45.164716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-27493c48-db72-46ac-a4fa-035087bc0631 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:45.165972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-27493c48-db72-46ac-a4fa-035087bc0631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:45.196721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939c990-c377-4696-a4e1-5981690cb7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:45.197390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939c990-c377-4696-a4e1-5981690cb7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:45.197685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939c990-c377-4696-a4e1-5981690cb7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:45.197966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939c990-c377-4696-a4e1-5981690cb7b4 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:45.198675 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939c990-c377-4696-a4e1-5981690cb7b4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:45.198992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939c990-c377-4696-a4e1-5981690cb7b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:45.200385 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939c990-c377-4696-a4e1-5981690cb7b4 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:45.205376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 495/988] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:45.210928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939c990-c377-4696-a4e1-5981690cb7b4 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:45.233729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:45.239714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 494/989] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:45.262472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27493c48-db72-46ac-a4fa-035087bc0631 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:45.273248 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:45.317243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939c990-c377-4696-a4e1-5981690cb7b4 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:45.350993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bb442-051a-428b-b52c-07b10cc57c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:45.351654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb442-051a-428b-b52c-07b10cc57c9a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:45.351944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb442-051a-428b-b52c-07b10cc57c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:45.352254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bb442-051a-428b-b52c-07b10cc57c9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:45.353049 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bb442-051a-428b-b52c-07b10cc57c9a None admin] RBAC: Adding query filter params (interface=public, service_id=f90b74f5da4d4011a6cc47c64e4ae93a, region_id=RegionOne) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:45.353368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bb442-051a-428b-b52c-07b10cc57c9a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:45.354728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bb442-051a-428b-b52c-07b10cc57c9a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:45.359747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 496/990] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 16 00:12:45 2022] GET /identity/v3/endpoints?service_id=f90b74f5da4d4011a6cc47c64e4ae93a&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:45.365536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bb442-051a-428b-b52c-07b10cc57c9a None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:45.370045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27493c48-db72-46ac-a4fa-035087bc0631 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:45.405596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29dc1-d691-414c-9ab5-50eb97f22f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:45.406354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29dc1-d691-414c-9ab5-50eb97f22f20 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:45.406689 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29dc1-d691-414c-9ab5-50eb97f22f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:45.406921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29dc1-d691-414c-9ab5-50eb97f22f20 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:45.408126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb29dc1-d691-414c-9ab5-50eb97f22f20 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:45.409499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb29dc1-d691-414c-9ab5-50eb97f22f20 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-ebb29dc1-d691-414c-9ab5-50eb97f22f20 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:45.421737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:45.422737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:45.423644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 495/991] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 16 00:12:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:45.428786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29dc1-d691-414c-9ab5-50eb97f22f20 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:45.473147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bb442-051a-428b-b52c-07b10cc57c9a None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:45.495543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:45.496167 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:45.508531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa65ad-e6a8-4115-888c-dc83eea66a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:45.509207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa65ad-e6a8-4115-888c-dc83eea66a16 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:45.509496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa65ad-e6a8-4115-888c-dc83eea66a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:45.509780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa65ad-e6a8-4115-888c-dc83eea66a16 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:45.510518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa65ad-e6a8-4115-888c-dc83eea66a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:45.511898 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa65ad-e6a8-4115-888c-dc83eea66a16 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:45.518512 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 497/992] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 16 00:12:45 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:12:45.550963 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29dc1-d691-414c-9ab5-50eb97f22f20 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:45.588285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720d4d-1ca2-47c0-9d4b-6e096cd9d092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:45.589291 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720d4d-1ca2-47c0-9d4b-6e096cd9d092 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:45.589792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720d4d-1ca2-47c0-9d4b-6e096cd9d092 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:45.590505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720d4d-1ca2-47c0-9d4b-6e096cd9d092 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:45.591414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26720d4d-1ca2-47c0-9d4b-6e096cd9d092 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:45.591912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26720d4d-1ca2-47c0-9d4b-6e096cd9d092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:45.593529 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26720d4d-1ca2-47c0-9d4b-6e096cd9d092 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:45.600085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 496/993] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 16 00:12:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:45.605708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa65ad-e6a8-4115-888c-dc83eea66a16 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:45.713340 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa65ad-e6a8-4115-888c-dc83eea66a16 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:45.747916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bfe65-f500-4c5d-bf3c-b8399e4cfdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:45.748610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bfe65-f500-4c5d-bf3c-b8399e4cfdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:45.748894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bfe65-f500-4c5d-bf3c-b8399e4cfdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:45.749174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bfe65-f500-4c5d-bf3c-b8399e4cfdd4 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:45.749883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bfe65-f500-4c5d-bf3c-b8399e4cfdd4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:45.750194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bfe65-f500-4c5d-bf3c-b8399e4cfdd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:45.751592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71bfe65-f500-4c5d-bf3c-b8399e4cfdd4 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:45.756601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 498/994] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 16 00:12:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:45.762535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720d4d-1ca2-47c0-9d4b-6e096cd9d092 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:45.866817 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720d4d-1ca2-47c0-9d4b-6e096cd9d092 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:45.893249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:45.902549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ff606-8943-4090-addd-cf6668d2cfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:45.903215 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff606-8943-4090-addd-cf6668d2cfd2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:45.903507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff606-8943-4090-addd-cf6668d2cfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:45.903789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff606-8943-4090-addd-cf6668d2cfd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:45.904623 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ff606-8943-4090-addd-cf6668d2cfd2 None admin] RBAC: Adding query filter params (interface=admin, service_id=9cc90dd8bd724fbc92e36a900b1f34ed, region_id=RegionOne) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:45.904943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ff606-8943-4090-addd-cf6668d2cfd2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:45.906308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ff606-8943-4090-addd-cf6668d2cfd2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:45.915859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 497/995] 10.222.0.16 () {56 vars in 1249 bytes} [Thu Jun 16 00:12:45 2022] GET /identity/v3/endpoints?service_id=9cc90dd8bd724fbc92e36a900b1f34ed&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:45.917135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bfe65-f500-4c5d-bf3c-b8399e4cfdd4 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:45.974734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:46.024839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ad218-e421-49cf-b229-b06fabb9f5b3 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:46.025131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ad218-e421-49cf-b229-b06fabb9f5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:46.025411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ad218-e421-49cf-b229-b06fabb9f5b3 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:46.026906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 498/996] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:46.031644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ecd1-2151-40ab-bcf1-a7bfdafa461f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:46.031940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ecd1-2151-40ab-bcf1-a7bfdafa461f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:46.032258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ecd1-2151-40ab-bcf1-a7bfdafa461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:46.035566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bfe65-f500-4c5d-bf3c-b8399e4cfdd4 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:46.050247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-39a7ecd1-2151-40ab-bcf1-a7bfdafa461f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:46.051425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-39a7ecd1-2151-40ab-bcf1-a7bfdafa461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:46.071244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d5d60-e4e7-4870-afd2-745cf978b894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:46.071917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d5d60-e4e7-4870-afd2-745cf978b894 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:46.072239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d5d60-e4e7-4870-afd2-745cf978b894 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:46.072521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d5d60-e4e7-4870-afd2-745cf978b894 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:46.073209 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d5d60-e4e7-4870-afd2-745cf978b894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:46.074568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d5d60-e4e7-4870-afd2-745cf978b894 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:46.081666 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 499/997] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 16 00:12:45 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:12:46.129567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 499/998] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:46.152393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d5d60-e4e7-4870-afd2-745cf978b894 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:46.262664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d5d60-e4e7-4870-afd2-745cf978b894 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:46.279488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:46.299504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e072f-eff3-4e61-a299-abb4bc0a2d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:46.300399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e072f-eff3-4e61-a299-abb4bc0a2d4d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:46.300687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e072f-eff3-4e61-a299-abb4bc0a2d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:46.300959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e072f-eff3-4e61-a299-abb4bc0a2d4d None admin] PATH_INFO: `/v3/services/image` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:46.301615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e072f-eff3-4e61-a299-abb4bc0a2d4d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:46.302975 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e072f-eff3-4e61-a299-abb4bc0a2d4d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-718e072f-eff3-4e61-a299-abb4bc0a2d4d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:46.314741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:46.315899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:46.321312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 500/999] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Jun 16 00:12:46 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:46.324474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7ecd1-2151-40ab-bcf1-a7bfdafa461f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:46.425160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7ecd1-2151-40ab-bcf1-a7bfdafa461f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:46.448049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:46.461228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70523a24-0bc7-4273-9709-52b0e32ab5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:46.461899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70523a24-0bc7-4273-9709-52b0e32ab5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:46.462195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70523a24-0bc7-4273-9709-52b0e32ab5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:46.462476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70523a24-0bc7-4273-9709-52b0e32ab5c3 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:46.463185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70523a24-0bc7-4273-9709-52b0e32ab5c3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:46.463498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70523a24-0bc7-4273-9709-52b0e32ab5c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:46.464905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70523a24-0bc7-4273-9709-52b0e32ab5c3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:46.470194 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 500/1000] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:46.475558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e072f-eff3-4e61-a299-abb4bc0a2d4d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:46.577362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e072f-eff3-4e61-a299-abb4bc0a2d4d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:46.612593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa222185-6efc-4201-800e-5d2902fbbb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:46.613293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa222185-6efc-4201-800e-5d2902fbbb20 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:46.613581 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa222185-6efc-4201-800e-5d2902fbbb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:46.613867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa222185-6efc-4201-800e-5d2902fbbb20 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:46.614605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa222185-6efc-4201-800e-5d2902fbbb20 None admin] RBAC: Adding query filter params (type=image) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:46.614919 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa222185-6efc-4201-800e-5d2902fbbb20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:46.616385 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa222185-6efc-4201-800e-5d2902fbbb20 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:46.621829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 501/1001] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:47.655460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d253-addd-4953-a284-763d86b0d35d None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.656007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d253-addd-4953-a284-763d86b0d35d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.656092 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4d253-addd-4953-a284-763d86b0d35d None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.657985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 501/1002] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:47.663082 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57a70d-cb25-4548-9cde-1f312398209a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.663466 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57a70d-cb25-4548-9cde-1f312398209a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.663634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57a70d-cb25-4548-9cde-1f312398209a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.681697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-1b57a70d-cb25-4548-9cde-1f312398209a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:47.683229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-1b57a70d-cb25-4548-9cde-1f312398209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:47.726561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:47.754937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 502/1003] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:47.777008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4d253-addd-4953-a284-763d86b0d35d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:47.883289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4d253-addd-4953-a284-763d86b0d35d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:47.917403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf845d13-2af7-4256-ac91-5d3a9014fa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:47.918131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf845d13-2af7-4256-ac91-5d3a9014fa42 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.918419 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf845d13-2af7-4256-ac91-5d3a9014fa42 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.918699 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf845d13-2af7-4256-ac91-5d3a9014fa42 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.919351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf845d13-2af7-4256-ac91-5d3a9014fa42 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:47.920752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf845d13-2af7-4256-ac91-5d3a9014fa42 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-bf845d13-2af7-4256-ac91-5d3a9014fa42 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:47.932944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:47.933902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:47.935379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 502/1004] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:47.940015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57a70d-cb25-4548-9cde-1f312398209a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.042888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57a70d-cb25-4548-9cde-1f312398209a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.075630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150121c-784c-4b10-8d83-f7fe66546cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.076328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150121c-784c-4b10-8d83-f7fe66546cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.076616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150121c-784c-4b10-8d83-f7fe66546cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.076896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150121c-784c-4b10-8d83-f7fe66546cf5 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.077599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150121c-784c-4b10-8d83-f7fe66546cf5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:48.077910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150121c-784c-4b10-8d83-f7fe66546cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.079814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150121c-784c-4b10-8d83-f7fe66546cf5 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.084957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 503/1005] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:48.090579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf845d13-2af7-4256-ac91-5d3a9014fa42 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.140657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.196476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf845d13-2af7-4256-ac91-5d3a9014fa42 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.231144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b257664-2fa8-4fae-9c88-a7409bb36638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.231814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257664-2fa8-4fae-9c88-a7409bb36638 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.232129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257664-2fa8-4fae-9c88-a7409bb36638 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.232410 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257664-2fa8-4fae-9c88-a7409bb36638 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.233116 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b257664-2fa8-4fae-9c88-a7409bb36638 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:48.233426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b257664-2fa8-4fae-9c88-a7409bb36638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.234791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b257664-2fa8-4fae-9c88-a7409bb36638 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.241242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 503/1006] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 16 00:12:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:48.245771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150121c-784c-4b10-8d83-f7fe66546cf5 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.247677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e662b7-a5fe-466a-8dac-896bceb56224 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.248008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e662b7-a5fe-466a-8dac-896bceb56224 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.248269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e662b7-a5fe-466a-8dac-896bceb56224 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.249738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 504/1007] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:48.255342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49f16-a5e6-451d-b2e3-a4a1e28fed52 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.255626 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49f16-a5e6-451d-b2e3-a4a1e28fed52 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.255902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49f16-a5e6-451d-b2e3-a4a1e28fed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.273685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-bec49f16-a5e6-451d-b2e3-a4a1e28fed52 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:48.275137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bec49f16-a5e6-451d-b2e3-a4a1e28fed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:48.289717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.350128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 505/1008] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:48.359479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150121c-784c-4b10-8d83-f7fe66546cf5 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.372811 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec49f16-a5e6-451d-b2e3-a4a1e28fed52 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.395619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d752-3bf9-4a14-955e-4b7090996f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.396317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d752-3bf9-4a14-955e-4b7090996f4e None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.396606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d752-3bf9-4a14-955e-4b7090996f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.396961 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d752-3bf9-4a14-955e-4b7090996f4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.397621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45d752-3bf9-4a14-955e-4b7090996f4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.399247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45d752-3bf9-4a14-955e-4b7090996f4e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.420392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 504/1009] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 16 00:12:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:48.426433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.490684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec49f16-a5e6-451d-b2e3-a4a1e28fed52 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.537976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdac625-da4f-4055-83aa-6d5cc86945fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.539240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac625-da4f-4055-83aa-6d5cc86945fd None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.539744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac625-da4f-4055-83aa-6d5cc86945fd None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.540249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac625-da4f-4055-83aa-6d5cc86945fd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.541116 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdac625-da4f-4055-83aa-6d5cc86945fd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.542763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdac625-da4f-4055-83aa-6d5cc86945fd None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-8cdac625-da4f-4055-83aa-6d5cc86945fd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:48.556345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:48.557416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:12:48.558293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:48.561065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 506/1010] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 16 00:12:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:48.568229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d752-3bf9-4a14-955e-4b7090996f4e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.679668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.687788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d752-3bf9-4a14-955e-4b7090996f4e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.711457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f0101-e611-4295-9c2c-65ad03aaf46c None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.712005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f0101-e611-4295-9c2c-65ad03aaf46c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.712177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f0101-e611-4295-9c2c-65ad03aaf46c None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.713812 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 507/1011] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:48.719336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c93ef-f378-4fd2-9322-d1bda1648370 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.719597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c93ef-f378-4fd2-9322-d1bda1648370 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.720385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c93ef-f378-4fd2-9322-d1bda1648370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.732033 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc391c-482c-41f4-92e5-13ea573d7a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.732723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc391c-482c-41f4-92e5-13ea573d7a94 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.733017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc391c-482c-41f4-92e5-13ea573d7a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.733297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc391c-482c-41f4-92e5-13ea573d7a94 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.734012 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc391c-482c-41f4-92e5-13ea573d7a94 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:48.734331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc391c-482c-41f4-92e5-13ea573d7a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.736405 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc391c-482c-41f4-92e5-13ea573d7a94 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.740578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-bc1c93ef-f378-4fd2-9322-d1bda1648370 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:48.741633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 505/1012] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 16 00:12:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:48.741767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bc1c93ef-f378-4fd2-9322-d1bda1648370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:48.747443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc391c-482c-41f4-92e5-13ea573d7a94 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.814154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 508/1013] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:48 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:48.837096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c93ef-f378-4fd2-9322-d1bda1648370 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.858662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc391c-482c-41f4-92e5-13ea573d7a94 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.872996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.900906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623a18d-99cc-433d-8edb-dd1c14a88011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.901577 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a18d-99cc-433d-8edb-dd1c14a88011 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.901860 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a18d-99cc-433d-8edb-dd1c14a88011 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.902147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a18d-99cc-433d-8edb-dd1c14a88011 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.902891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623a18d-99cc-433d-8edb-dd1c14a88011 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:48.903201 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623a18d-99cc-433d-8edb-dd1c14a88011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.904658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623a18d-99cc-433d-8edb-dd1c14a88011 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.915317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 506/1014] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 16 00:12:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:48.916313 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623a18d-99cc-433d-8edb-dd1c14a88011 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.942783 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.953643 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c93ef-f378-4fd2-9322-d1bda1648370 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.989504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80065-38ff-40c1-88a2-e879f9eb9f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.990169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80065-38ff-40c1-88a2-e879f9eb9f1d None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.990455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80065-38ff-40c1-88a2-e879f9eb9f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.990736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80065-38ff-40c1-88a2-e879f9eb9f1d None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.991470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80065-38ff-40c1-88a2-e879f9eb9f1d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.992932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80065-38ff-40c1-88a2-e879f9eb9f1d None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:49.012003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 509/1015] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:12:48 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:12:49.032030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623a18d-99cc-433d-8edb-dd1c14a88011 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:49.080362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03ea34-845c-4b79-b2d5-f4089f2ab474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:49.081038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03ea34-845c-4b79-b2d5-f4089f2ab474 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:49.081327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03ea34-845c-4b79-b2d5-f4089f2ab474 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:49.081611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03ea34-845c-4b79-b2d5-f4089f2ab474 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:49.082363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03ea34-845c-4b79-b2d5-f4089f2ab474 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:49.083762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03ea34-845c-4b79-b2d5-f4089f2ab474 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:49.100445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 507/1016] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 16 00:12:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:50.687544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f82be4-b12b-48fd-b8ed-79dc853d4dbd None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.688090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f82be4-b12b-48fd-b8ed-79dc853d4dbd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.688168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f82be4-b12b-48fd-b8ed-79dc853d4dbd None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:50.690085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 510/1017] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:50.695110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9d012-d7f3-4eeb-920c-164c415b88a6 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.695510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9d012-d7f3-4eeb-920c-164c415b88a6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.695678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9d012-d7f3-4eeb-920c-164c415b88a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:50.712615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-55f9d012-d7f3-4eeb-920c-164c415b88a6 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:50.713808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-55f9d012-d7f3-4eeb-920c-164c415b88a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:50.789924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 508/1018] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:50.812869 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f82be4-b12b-48fd-b8ed-79dc853d4dbd None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:50.929420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:50.941471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f82be4-b12b-48fd-b8ed-79dc853d4dbd None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:50.985840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a168a7-ff3d-4383-9165-449cefffea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:50.986668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a168a7-ff3d-4383-9165-449cefffea8b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.987010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a168a7-ff3d-4383-9165-449cefffea8b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.987295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a168a7-ff3d-4383-9165-449cefffea8b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.006317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a168a7-ff3d-4383-9165-449cefffea8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-b5a168a7-ff3d-4383-9165-449cefffea8b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:51.026633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:51.027671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:51.028539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:51.031284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 511/1019] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 16 00:12:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:51.038677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9d012-d7f3-4eeb-920c-164c415b88a6 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.041861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:51.152238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9d012-d7f3-4eeb-920c-164c415b88a6 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.155515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d693d1f-8775-479d-b396-daa907597a1d None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.155805 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d693d1f-8775-479d-b396-daa907597a1d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.156275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d693d1f-8775-479d-b396-daa907597a1d None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.157613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 512/1020] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:51.163517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a9bb-8063-4eb1-96c1-5889d8f766ca None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.163835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a9bb-8063-4eb1-96c1-5889d8f766ca None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.164109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a9bb-8063-4eb1-96c1-5889d8f766ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.188325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6cf0a9bb-8063-4eb1-96c1-5889d8f766ca None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:51.190667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6cf0a9bb-8063-4eb1-96c1-5889d8f766ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:51.194587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df854ad7-fcc4-4e2e-91b3-ad54a0981070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.195217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df854ad7-fcc4-4e2e-91b3-ad54a0981070 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.195500 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df854ad7-fcc4-4e2e-91b3-ad54a0981070 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.195780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df854ad7-fcc4-4e2e-91b3-ad54a0981070 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.196562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df854ad7-fcc4-4e2e-91b3-ad54a0981070 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:51.196875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df854ad7-fcc4-4e2e-91b3-ad54a0981070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:51.198248 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df854ad7-fcc4-4e2e-91b3-ad54a0981070 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:51.211914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 509/1021] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:51.217736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df854ad7-fcc4-4e2e-91b3-ad54a0981070 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.272016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 513/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:51.272453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be528-4217-468c-a192-327beedb8924 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.272745 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be528-4217-468c-a192-327beedb8924 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.273027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853be528-4217-468c-a192-327beedb8924 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.274315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 514/1023] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:51.280956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cf665-7824-4f1c-b601-1446bc8971ce None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.281246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cf665-7824-4f1c-b601-1446bc8971ce None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.281527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cf665-7824-4f1c-b601-1446bc8971ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.297531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:51.299702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a07cf665-7824-4f1c-b601-1446bc8971ce None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:51.301011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a07cf665-7824-4f1c-b601-1446bc8971ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:51.333945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df854ad7-fcc4-4e2e-91b3-ad54a0981070 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.366316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 515/1024] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:51.367254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71bb97-f73f-4204-8d53-a5fd489c95df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.367467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cf665-7824-4f1c-b601-1446bc8971ce None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.368111 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71bb97-f73f-4204-8d53-a5fd489c95df None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.368363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71bb97-f73f-4204-8d53-a5fd489c95df None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.368641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71bb97-f73f-4204-8d53-a5fd489c95df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.382720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:51.385588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71bb97-f73f-4204-8d53-a5fd489c95df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:51.387059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71bb97-f73f-4204-8d53-a5fd489c95df None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-7c71bb97-f73f-4204-8d53-a5fd489c95df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:51.404158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:51.405142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:51.406043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:51.406043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:51.406043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:51.406043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:51.406043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 510/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:51.406702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71bb97-f73f-4204-8d53-a5fd489c95df None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.468472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cf665-7824-4f1c-b601-1446bc8971ce None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.501989 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bf965-ef13-49fd-9ce3-63dfa05207ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.502772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf965-ef13-49fd-9ce3-63dfa05207ed None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.503059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf965-ef13-49fd-9ce3-63dfa05207ed None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.503337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf965-ef13-49fd-9ce3-63dfa05207ed None admin] PATH_INFO: `/v3/services/image` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.504006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bf965-ef13-49fd-9ce3-63dfa05207ed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:51.505366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bf965-ef13-49fd-9ce3-63dfa05207ed None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:51.507750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71bb97-f73f-4204-8d53-a5fd489c95df None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-6d0bf965-ef13-49fd-9ce3-63dfa05207ed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:51.517302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:51.518481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:51.519348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 516/1026] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:51.520218 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bf965-ef13-49fd-9ce3-63dfa05207ed None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.527162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:51.543625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016f0c5-79dc-4f5c-9948-308392ebcb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.544444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016f0c5-79dc-4f5c-9948-308392ebcb66 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.544727 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016f0c5-79dc-4f5c-9948-308392ebcb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.545001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016f0c5-79dc-4f5c-9948-308392ebcb66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.546162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016f0c5-79dc-4f5c-9948-308392ebcb66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:51.547583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016f0c5-79dc-4f5c-9948-308392ebcb66 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:51.549242 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 511/1027] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:51.549980 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016f0c5-79dc-4f5c-9948-308392ebcb66 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.604023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:51.625131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bf965-ef13-49fd-9ce3-63dfa05207ed None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.646714 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016f0c5-79dc-4f5c-9948-308392ebcb66 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.658320 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c46d-8e3b-4f9c-9c29-ccdc03babd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.658982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c46d-8e3b-4f9c-9c29-ccdc03babd52 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.659263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c46d-8e3b-4f9c-9c29-ccdc03babd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.659538 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54c46d-8e3b-4f9c-9c29-ccdc03babd52 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.660286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c46d-8e3b-4f9c-9c29-ccdc03babd52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:51.660592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c46d-8e3b-4f9c-9c29-ccdc03babd52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:51.661943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54c46d-8e3b-4f9c-9c29-ccdc03babd52 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:51.673255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 517/1028] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:51.674002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c46d-8e3b-4f9c-9c29-ccdc03babd52 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.681078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cf395-2624-4010-ad71-c5cf46266357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.681758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cf395-2624-4010-ad71-c5cf46266357 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.682047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cf395-2624-4010-ad71-c5cf46266357 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.682329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cf395-2624-4010-ad71-c5cf46266357 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.683039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cf395-2624-4010-ad71-c5cf46266357 None admin] RBAC: Adding query filter params (name=image) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:51.683354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cf395-2624-4010-ad71-c5cf46266357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:51.684749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cf395-2624-4010-ad71-c5cf46266357 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:51.690236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 512/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:51.690858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cf395-2624-4010-ad71-c5cf46266357 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.740172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:51.773255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54c46d-8e3b-4f9c-9c29-ccdc03babd52 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.789229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cf395-2624-4010-ad71-c5cf46266357 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.807948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31e04a-fee3-4cd7-bd7c-0fc06b241444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.808638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e04a-fee3-4cd7-bd7c-0fc06b241444 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.808928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e04a-fee3-4cd7-bd7c-0fc06b241444 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.809206 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e04a-fee3-4cd7-bd7c-0fc06b241444 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.809911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31e04a-fee3-4cd7-bd7c-0fc06b241444 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:51.811330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31e04a-fee3-4cd7-bd7c-0fc06b241444 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:51.819329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:51.823146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509db20-930b-47d8-9d5a-a85aff118993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.823937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509db20-930b-47d8-9d5a-a85aff118993 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.824267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509db20-930b-47d8-9d5a-a85aff118993 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.824547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509db20-930b-47d8-9d5a-a85aff118993 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.833074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509db20-930b-47d8-9d5a-a85aff118993 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:51.834503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509db20-930b-47d8-9d5a-a85aff118993 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:51.847996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 518/1030] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:12:51 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:51.847996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31e04a-fee3-4cd7-bd7c-0fc06b241444 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-e509db20-930b-47d8-9d5a-a85aff118993 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:51.848938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:51.850013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:51.851007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:51.851007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:51.851007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:51.851007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:51.851007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:51.851007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:51.851007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:51.851007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:51.851007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:51.851007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:51.852454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 513/1031] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:51.856523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509db20-930b-47d8-9d5a-a85aff118993 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.961097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31e04a-fee3-4cd7-bd7c-0fc06b241444 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.973342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509db20-930b-47d8-9d5a-a85aff118993 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.985114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:52.002294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8098f-00d4-4eea-b4a5-d04bce671357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:52.002885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8098f-00d4-4eea-b4a5-d04bce671357 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.003770 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8098f-00d4-4eea-b4a5-d04bce671357 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.003770 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8098f-00d4-4eea-b4a5-d04bce671357 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.004164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8098f-00d4-4eea-b4a5-d04bce671357 None admin] RBAC: Adding query filter params (type=image) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:52.004473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8098f-00d4-4eea-b4a5-d04bce671357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:52.005843 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8098f-00d4-4eea-b4a5-d04bce671357 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:52.012864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 519/1032] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:52.016269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a064fc-4be1-4ed2-82df-f200bde73f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:52.016269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a064fc-4be1-4ed2-82df-f200bde73f0f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.016269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a064fc-4be1-4ed2-82df-f200bde73f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.016269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a064fc-4be1-4ed2-82df-f200bde73f0f None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.018310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a064fc-4be1-4ed2-82df-f200bde73f0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:52.018310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a064fc-4be1-4ed2-82df-f200bde73f0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:52.019489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8098f-00d4-4eea-b4a5-d04bce671357 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:52.022705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a064fc-4be1-4ed2-82df-f200bde73f0f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:52.044080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 514/1033] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:52.049874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a064fc-4be1-4ed2-82df-f200bde73f0f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:52.080789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:52.128670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8098f-00d4-4eea-b4a5-d04bce671357 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:52.161273 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a064fc-4be1-4ed2-82df-f200bde73f0f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:52.163662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a6bb9-12d8-4477-a8da-044054a95890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:52.164361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a6bb9-12d8-4477-a8da-044054a95890 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.164653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a6bb9-12d8-4477-a8da-044054a95890 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.164937 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a6bb9-12d8-4477-a8da-044054a95890 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.165728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a6bb9-12d8-4477-a8da-044054a95890 None admin] RBAC: Adding query filter params (interface=public, service_id=3a733e9ad442492e8bb57e52dc33fc7b, region_id=RegionOne) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:52.166049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a6bb9-12d8-4477-a8da-044054a95890 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:52.167426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a6bb9-12d8-4477-a8da-044054a95890 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:52.172517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 520/1034] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 16 00:12:52 2022] GET /identity/v3/endpoints?service_id=3a733e9ad442492e8bb57e52dc33fc7b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:52.178033 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a6bb9-12d8-4477-a8da-044054a95890 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:52.201386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd4d7d-5a2c-4835-93ec-fe1227f15927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:52.202054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd4d7d-5a2c-4835-93ec-fe1227f15927 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.202342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd4d7d-5a2c-4835-93ec-fe1227f15927 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.202625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd4d7d-5a2c-4835-93ec-fe1227f15927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.240955 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:52.276499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd4d7d-5a2c-4835-93ec-fe1227f15927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:52.277864 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd4d7d-5a2c-4835-93ec-fe1227f15927 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:52.286651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a6bb9-12d8-4477-a8da-044054a95890 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:52.304325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:52.323629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c37b47-ce94-4bca-b418-275dec76af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:52.324322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c37b47-ce94-4bca-b418-275dec76af4b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.324608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c37b47-ce94-4bca-b418-275dec76af4b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.324890 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c37b47-ce94-4bca-b418-275dec76af4b None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.325682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c37b47-ce94-4bca-b418-275dec76af4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:52.327175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c37b47-ce94-4bca-b418-275dec76af4b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:52.340523 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 521/1035] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 16 00:12:52 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:12:52.386634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 515/1036] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:52 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:12:52.393021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c37b47-ce94-4bca-b418-275dec76af4b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:52.504951 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c37b47-ce94-4bca-b418-275dec76af4b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:52.540994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16612503-1c60-4c21-8c3c-ff04a3794df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:52.541715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612503-1c60-4c21-8c3c-ff04a3794df4 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.542004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612503-1c60-4c21-8c3c-ff04a3794df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.542286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612503-1c60-4c21-8c3c-ff04a3794df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.553826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16612503-1c60-4c21-8c3c-ff04a3794df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:52.555259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16612503-1c60-4c21-8c3c-ff04a3794df4 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-16612503-1c60-4c21-8c3c-ff04a3794df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:52.572507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:52.573422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:52.574349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:52.574349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:52.574349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:52.574349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:52.574349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 522/1037] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:52.580047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd4d7d-5a2c-4835-93ec-fe1227f15927 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:52.646784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:52.681296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd4d7d-5a2c-4835-93ec-fe1227f15927 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:52.715474 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac4fc2-920e-4a1b-a738-f48de1a584c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:52.716585 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac4fc2-920e-4a1b-a738-f48de1a584c7 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.717077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac4fc2-920e-4a1b-a738-f48de1a584c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.717574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac4fc2-920e-4a1b-a738-f48de1a584c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.718549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac4fc2-920e-4a1b-a738-f48de1a584c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:52.719072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac4fc2-920e-4a1b-a738-f48de1a584c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:52.720732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac4fc2-920e-4a1b-a738-f48de1a584c7 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:52.732372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 516/1038] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:52.738071 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16612503-1c60-4c21-8c3c-ff04a3794df4 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:52.773040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:52.840491 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16612503-1c60-4c21-8c3c-ff04a3794df4 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:52.874389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a504d6e-9888-47b6-b4d4-e8f65561d05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:52.875520 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a504d6e-9888-47b6-b4d4-e8f65561d05f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.876581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a504d6e-9888-47b6-b4d4-e8f65561d05f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.877068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a504d6e-9888-47b6-b4d4-e8f65561d05f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.883992 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a504d6e-9888-47b6-b4d4-e8f65561d05f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:52.885658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a504d6e-9888-47b6-b4d4-e8f65561d05f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-6a504d6e-9888-47b6-b4d4-e8f65561d05f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:52.899864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:52.900926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:52.901825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:52.901825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:52.901825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:52.901825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:52.901825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:52.901825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:52.901825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:52.901825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:52.904226 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 523/1039] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:52.911470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac4fc2-920e-4a1b-a738-f48de1a584c7 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:53.013068 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac4fc2-920e-4a1b-a738-f48de1a584c7 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:53.049021 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:53.058041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948650aa-9205-42f4-8d4d-246583a828d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:53.058718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948650aa-9205-42f4-8d4d-246583a828d4 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:53.059006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948650aa-9205-42f4-8d4d-246583a828d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:53.059285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948650aa-9205-42f4-8d4d-246583a828d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:53.060109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948650aa-9205-42f4-8d4d-246583a828d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:53.060429 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948650aa-9205-42f4-8d4d-246583a828d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:53.061858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948650aa-9205-42f4-8d4d-246583a828d4 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:53.079684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 517/1040] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:53.081161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a504d6e-9888-47b6-b4d4-e8f65561d05f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:53.176375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:53.184138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a504d6e-9888-47b6-b4d4-e8f65561d05f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:53.218276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4ee44-ac47-4aa7-abdf-79e748c61c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:53.218927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ee44-ac47-4aa7-abdf-79e748c61c59 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:53.219206 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ee44-ac47-4aa7-abdf-79e748c61c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:53.219478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ee44-ac47-4aa7-abdf-79e748c61c59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:53.220850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4ee44-ac47-4aa7-abdf-79e748c61c59 None admin] RBAC: Adding query filter params (role.id=ae85f17673084352ab9b3953669ab67e, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=cd57046b084b463488296b825097081d) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:53.221161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4ee44-ac47-4aa7-abdf-79e748c61c59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:53.222666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4ee44-ac47-4aa7-abdf-79e748c61c59 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:53.228213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 524/1041] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:53 2022] GET /identity/v3/role_assignments?user.id=cd57046b084b463488296b825097081d&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=ae85f17673084352ab9b3953669ab67e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:54.012707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bba138-91a1-4148-a338-c5dc007075bc None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.013354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bba138-91a1-4148-a338-c5dc007075bc None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.013354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bba138-91a1-4148-a338-c5dc007075bc None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.017584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 518/1042] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:54.024595 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfba8dc-d48f-492d-a433-26051e096bb0 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.024976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfba8dc-d48f-492d-a433-26051e096bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.025183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfba8dc-d48f-492d-a433-26051e096bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.042383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ebfba8dc-d48f-492d-a433-26051e096bb0 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:54.043567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ebfba8dc-d48f-492d-a433-26051e096bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:54.111512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 525/1043] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:54.135466 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bba138-91a1-4148-a338-c5dc007075bc None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:54.237738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bba138-91a1-4148-a338-c5dc007075bc None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:54.272385 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7ffea-aa9a-4b10-bc2c-b0293f7c4090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:54.273140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7ffea-aa9a-4b10-bc2c-b0293f7c4090 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.273423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7ffea-aa9a-4b10-bc2c-b0293f7c4090 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.273699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7ffea-aa9a-4b10-bc2c-b0293f7c4090 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.275044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7ffea-aa9a-4b10-bc2c-b0293f7c4090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:54.276571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7ffea-aa9a-4b10-bc2c-b0293f7c4090 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:54.286724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 519/1044] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:54.286890 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfba8dc-d48f-492d-a433-26051e096bb0 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:54.373693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:54.387277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfba8dc-d48f-492d-a433-26051e096bb0 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:54.425072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53150d5c-ad0e-4b2a-b5e3-ce778b3641f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:54.425772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150d5c-ad0e-4b2a-b5e3-ce778b3641f6 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.426058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150d5c-ad0e-4b2a-b5e3-ce778b3641f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.426338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150d5c-ad0e-4b2a-b5e3-ce778b3641f6 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.427067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53150d5c-ad0e-4b2a-b5e3-ce778b3641f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:54.428560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53150d5c-ad0e-4b2a-b5e3-ce778b3641f6 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:54.451435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 526/1045] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:12:54 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:54.470202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd165259-86b8-4c3d-8f26-09557015dbfc None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.470529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd165259-86b8-4c3d-8f26-09557015dbfc None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.470826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd165259-86b8-4c3d-8f26-09557015dbfc None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.472336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 520/1046] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:54.478263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d82618-22d3-469d-b770-66ded859fc0f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.478571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d82618-22d3-469d-b770-66ded859fc0f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.478831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d82618-22d3-469d-b770-66ded859fc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.496816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-51d82618-22d3-469d-b770-66ded859fc0f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:54.498295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-51d82618-22d3-469d-b770-66ded859fc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:54.573473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 527/1047] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:54.596872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd165259-86b8-4c3d-8f26-09557015dbfc None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:54.656611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:54.704106 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd165259-86b8-4c3d-8f26-09557015dbfc None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:54.741189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6b6f-f027-471b-b011-49f56ca7d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:54.742029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6b6f-f027-471b-b011-49f56ca7d49b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.742320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6b6f-f027-471b-b011-49f56ca7d49b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.742647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff6b6f-f027-471b-b011-49f56ca7d49b None admin] PATH_INFO: `/v3/services/image` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.743309 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff6b6f-f027-471b-b011-49f56ca7d49b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:54.744700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff6b6f-f027-471b-b011-49f56ca7d49b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-11ff6b6f-f027-471b-b011-49f56ca7d49b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:54.757745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:54.758710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 521/1048] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Jun 16 00:12:54 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:54.764341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d82618-22d3-469d-b770-66ded859fc0f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:54.843000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:54.871951 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d82618-22d3-469d-b770-66ded859fc0f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:54.907118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb992db9-f88c-4947-9ed3-323e2f5555f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:54.907942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb992db9-f88c-4947-9ed3-323e2f5555f5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.908353 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb992db9-f88c-4947-9ed3-323e2f5555f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.908731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb992db9-f88c-4947-9ed3-323e2f5555f5 None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.909536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb992db9-f88c-4947-9ed3-323e2f5555f5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:54.909947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb992db9-f88c-4947-9ed3-323e2f5555f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:54.911398 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb992db9-f88c-4947-9ed3-323e2f5555f5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:54.921143 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 528/1049] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:54.922198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6b6f-f027-471b-b011-49f56ca7d49b None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.032507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff6b6f-f027-471b-b011-49f56ca7d49b None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.052744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:55.067479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82d516-f8fc-4d43-833b-937e63c6cbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.068179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82d516-f8fc-4d43-833b-937e63c6cbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.068468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82d516-f8fc-4d43-833b-937e63c6cbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.068745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82d516-f8fc-4d43-833b-937e63c6cbe1 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.069449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82d516-f8fc-4d43-833b-937e63c6cbe1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:55.069757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82d516-f8fc-4d43-833b-937e63c6cbe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:55.071112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82d516-f8fc-4d43-833b-937e63c6cbe1 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:55.080165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 522/1050] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:55.082484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb992db9-f88c-4947-9ed3-323e2f5555f5 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.186152 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb992db9-f88c-4947-9ed3-323e2f5555f5 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.220354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9deae-b8dc-43e9-a853-4a97c3f2857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.221087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9deae-b8dc-43e9-a853-4a97c3f2857b None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.221379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9deae-b8dc-43e9-a853-4a97c3f2857b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.221658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9deae-b8dc-43e9-a853-4a97c3f2857b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.222413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9deae-b8dc-43e9-a853-4a97c3f2857b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:55.223789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9deae-b8dc-43e9-a853-4a97c3f2857b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:55.230960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:55.252021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 529/1051] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 16 00:12:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:55.321878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41bde9-df4e-44e7-ac1e-f16254ef6175 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.322174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41bde9-df4e-44e7-ac1e-f16254ef6175 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.322455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41bde9-df4e-44e7-ac1e-f16254ef6175 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.324045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 523/1052] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:55.329556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48b529-106e-4107-94fa-60221c1a7465 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.329850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48b529-106e-4107-94fa-60221c1a7465 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.330132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48b529-106e-4107-94fa-60221c1a7465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.349363 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4b48b529-106e-4107-94fa-60221c1a7465 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:55.350575 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4b48b529-106e-4107-94fa-60221c1a7465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:55.430322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 530/1053] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:55.452486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41bde9-df4e-44e7-ac1e-f16254ef6175 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.556980 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41bde9-df4e-44e7-ac1e-f16254ef6175 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.590681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e224-d0ed-455d-8263-43f5cc826826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.591493 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e224-d0ed-455d-8263-43f5cc826826 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.591778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e224-d0ed-455d-8263-43f5cc826826 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.592084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7e224-d0ed-455d-8263-43f5cc826826 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.602386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7e224-d0ed-455d-8263-43f5cc826826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-bfe7e224-d0ed-455d-8263-43f5cc826826 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:55.611409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:55.612705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:55.613565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:55.614742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 524/1054] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 16 00:12:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:55.619377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48b529-106e-4107-94fa-60221c1a7465 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.720100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48b529-106e-4107-94fa-60221c1a7465 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.740521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:55.759221 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b81a-380d-4283-a3ec-7c63858871eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.760002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b81a-380d-4283-a3ec-7c63858871eb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.760361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b81a-380d-4283-a3ec-7c63858871eb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.760734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255b81a-380d-4283-a3ec-7c63858871eb None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.761533 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b81a-380d-4283-a3ec-7c63858871eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:55.761919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b81a-380d-4283-a3ec-7c63858871eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:55.763349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255b81a-380d-4283-a3ec-7c63858871eb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:55.771721 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 531/1055] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 16 00:12:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:55.777097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e224-d0ed-455d-8263-43f5cc826826 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.825566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:55.881071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7e224-d0ed-455d-8263-43f5cc826826 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.914098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165901a-109c-4c83-b354-cdf6374218dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.915035 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165901a-109c-4c83-b354-cdf6374218dd None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.915424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165901a-109c-4c83-b354-cdf6374218dd None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.915805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165901a-109c-4c83-b354-cdf6374218dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.926964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165901a-109c-4c83-b354-cdf6374218dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:55.928561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165901a-109c-4c83-b354-cdf6374218dd None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-b165901a-109c-4c83-b354-cdf6374218dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:55.945583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:55.946636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:55.947782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:55.947782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:55.947782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:55.947782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:55.949196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 525/1056] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:55.954669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b81a-380d-4283-a3ec-7c63858871eb None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.062992 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255b81a-380d-4283-a3ec-7c63858871eb None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.096605 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5c0e-860e-4e6c-9416-4253ccc6bfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.097328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5c0e-860e-4e6c-9416-4253ccc6bfa3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.097553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5c0e-860e-4e6c-9416-4253ccc6bfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.097927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5c0e-860e-4e6c-9416-4253ccc6bfa3 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.098658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea5c0e-860e-4e6c-9416-4253ccc6bfa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:56.098985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea5c0e-860e-4e6c-9416-4253ccc6bfa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.100410 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea5c0e-860e-4e6c-9416-4253ccc6bfa3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.117117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 532/1057] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:56.118507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165901a-109c-4c83-b354-cdf6374218dd None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.211258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.218476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165901a-109c-4c83-b354-cdf6374218dd None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.252313 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872df32-2b11-441b-b354-449ae28814c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.253109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872df32-2b11-441b-b354-449ae28814c8 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.253444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872df32-2b11-441b-b354-449ae28814c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.253729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872df32-2b11-441b-b354-449ae28814c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.261147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872df32-2b11-441b-b354-449ae28814c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.262589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872df32-2b11-441b-b354-449ae28814c8 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-a872df32-2b11-441b-b354-449ae28814c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:12:56.277233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:56.278153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:56.279105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:56.279105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:56.279105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:12:56.279105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:12:56.279105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:12:56.279105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:12:56.279105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:12:56.279105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:12:56.279105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:12:56.279105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:56.279105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 526/1058] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:56.286025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5c0e-860e-4e6c-9416-4253ccc6bfa3 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.330331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.389930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5c0e-860e-4e6c-9416-4253ccc6bfa3 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.424907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f21c2-7625-4654-a2bd-551bbe515645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.425809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f21c2-7625-4654-a2bd-551bbe515645 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.426242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f21c2-7625-4654-a2bd-551bbe515645 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.426669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f21c2-7625-4654-a2bd-551bbe515645 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.427680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f21c2-7625-4654-a2bd-551bbe515645 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:56.428202 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f21c2-7625-4654-a2bd-551bbe515645 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.429831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f21c2-7625-4654-a2bd-551bbe515645 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.447760 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 533/1059] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:56.453067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872df32-2b11-441b-b354-449ae28814c8 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.553860 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872df32-2b11-441b-b354-449ae28814c8 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.586692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ff9ff-0c94-44fb-ae32-ffcef90f983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.587518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ff9ff-0c94-44fb-ae32-ffcef90f983a None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.587802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ff9ff-0c94-44fb-ae32-ffcef90f983a None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.588111 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ff9ff-0c94-44fb-ae32-ffcef90f983a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.600696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ff9ff-0c94-44fb-ae32-ffcef90f983a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.602181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ff9ff-0c94-44fb-ae32-ffcef90f983a None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-8c3ff9ff-0c94-44fb-ae32-ffcef90f983a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:56.621426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:56.622409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:56.629014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:56.629014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:56.629014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:56.629014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:56.629014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 527/1060] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:56.629305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f21c2-7625-4654-a2bd-551bbe515645 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.660381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e395f7-8a02-4909-9703-2f0c560ec110 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.660670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e395f7-8a02-4909-9703-2f0c560ec110 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.660949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e395f7-8a02-4909-9703-2f0c560ec110 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.662314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 528/1061] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:56.668244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3e2bf-5981-4854-aa2f-ab9f58732848 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.668541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3e2bf-5981-4854-aa2f-ab9f58732848 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.668821 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3e2bf-5981-4854-aa2f-ab9f58732848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.686066 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-71e3e2bf-5981-4854-aa2f-ab9f58732848 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:56.687244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-71e3e2bf-5981-4854-aa2f-ab9f58732848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:56.689341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.736360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.739383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f21c2-7625-4654-a2bd-551bbe515645 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.767383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 529/1062] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:56.775685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3bb14-186a-4b28-abca-f0b9e483fb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.776480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3bb14-186a-4b28-abca-f0b9e483fb14 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.776830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3bb14-186a-4b28-abca-f0b9e483fb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.777113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3bb14-186a-4b28-abca-f0b9e483fb14 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.777864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3bb14-186a-4b28-abca-f0b9e483fb14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:56.778178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3bb14-186a-4b28-abca-f0b9e483fb14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.779575 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3bb14-186a-4b28-abca-f0b9e483fb14 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.790496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3e2bf-5981-4854-aa2f-ab9f58732848 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.792192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 534/1063] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:56.798740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3bb14-186a-4b28-abca-f0b9e483fb14 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.900654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3bb14-186a-4b28-abca-f0b9e483fb14 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.903486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3e2bf-5981-4854-aa2f-ab9f58732848 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.935444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4475f8c-3a20-4d56-aeb6-b2b3ec4b9aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.936265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475f8c-3a20-4d56-aeb6-b2b3ec4b9aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.936546 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475f8c-3a20-4d56-aeb6-b2b3ec4b9aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.936819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475f8c-3a20-4d56-aeb6-b2b3ec4b9aa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.939795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e47f4-6f69-4f99-8ea3-bfa2395397d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.941957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e47f4-6f69-4f99-8ea3-bfa2395397d9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.941957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e47f4-6f69-4f99-8ea3-bfa2395397d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.941957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e47f4-6f69-4f99-8ea3-bfa2395397d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.946736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4475f8c-3a20-4d56-aeb6-b2b3ec4b9aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.948204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4475f8c-3a20-4d56-aeb6-b2b3ec4b9aa2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.948815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.952917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e47f4-6f69-4f99-8ea3-bfa2395397d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-4b7e47f4-6f69-4f99-8ea3-bfa2395397d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:56.961503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:56.962450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:56.963334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-b4475f8c-3a20-4d56-aeb6-b2b3ec4b9aa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:12:56.964007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:56.964897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:56.967567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:12:56.967567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:12:56.967567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:12:56.967567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:12:56.967567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:12:56.967567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:12:56.967567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:12:56.967567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:56.969076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 530/1064] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:56.969076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e47f4-6f69-4f99-8ea3-bfa2395397d9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.969366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 535/1065] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:56.970333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4475f8c-3a20-4d56-aeb6-b2b3ec4b9aa2 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.993697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.078504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e47f4-6f69-4f99-8ea3-bfa2395397d9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.081948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4475f8c-3a20-4d56-aeb6-b2b3ec4b9aa2 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.113720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fad6c3-7bed-43a4-86c1-0c4bcfbe600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.114415 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad6c3-7bed-43a4-86c1-0c4bcfbe600c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.114707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad6c3-7bed-43a4-86c1-0c4bcfbe600c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.114990 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fad6c3-7bed-43a4-86c1-0c4bcfbe600c None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.115758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fad6c3-7bed-43a4-86c1-0c4bcfbe600c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:57.116072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fad6c3-7bed-43a4-86c1-0c4bcfbe600c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.117456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fad6c3-7bed-43a4-86c1-0c4bcfbe600c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.121175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedabc05-cb01-4c98-b8c7-ace20d75e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.122423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedabc05-cb01-4c98-b8c7-ace20d75e527 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.122907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedabc05-cb01-4c98-b8c7-ace20d75e527 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.123371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedabc05-cb01-4c98-b8c7-ace20d75e527 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.124412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedabc05-cb01-4c98-b8c7-ace20d75e527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:57.124907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedabc05-cb01-4c98-b8c7-ace20d75e527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.126524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 531/1066] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:57.127578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedabc05-cb01-4c98-b8c7-ace20d75e527 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.131989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fad6c3-7bed-43a4-86c1-0c4bcfbe600c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.146803 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 536/1067] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:57.148084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedabc05-cb01-4c98-b8c7-ace20d75e527 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.196698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.232310 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.244558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fad6c3-7bed-43a4-86c1-0c4bcfbe600c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.252165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedabc05-cb01-4c98-b8c7-ace20d75e527 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.279496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf9f93-af4b-409d-9d10-af96d7e6a8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.280383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf9f93-af4b-409d-9d10-af96d7e6a8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.280670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf9f93-af4b-409d-9d10-af96d7e6a8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.280951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf9f93-af4b-409d-9d10-af96d7e6a8f9 None admin] PATH_INFO: `/v3/users/3dbaa024014f464e8a62ec4fe4a985d4` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.287478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51faa891-cbb7-4808-b81b-b0115a91d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.288399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faa891-cbb7-4808-b81b-b0115a91d3f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.288688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faa891-cbb7-4808-b81b-b0115a91d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.288969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faa891-cbb7-4808-b81b-b0115a91d3f5 None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/cd57046b084b463488296b825097081d/roles/ae85f17673084352ab9b3953669ab67e` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.291198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51faa891-cbb7-4808-b81b-b0115a91d3f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=cd57046b084b463488296b825097081d, role_id=ae85f17673084352ab9b3953669ab67e)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.292742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51faa891-cbb7-4808-b81b-b0115a91d3f5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.296667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf9f93-af4b-409d-9d10-af96d7e6a8f9 None admin] RBAC: Authorizing `identity:get_user(user_id=3dbaa024014f464e8a62ec4fe4a985d4)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.298052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf9f93-af4b-409d-9d10-af96d7e6a8f9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.300051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 532/1068] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/users/3dbaa024014f464e8a62ec4fe4a985d4 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:57.306173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf9f93-af4b-409d-9d10-af96d7e6a8f9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.307098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 537/1069] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:12:57 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/cd57046b084b463488296b825097081d/roles/ae85f17673084352ab9b3953669ab67e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:12:57.406737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e1a7-e8bc-4be5-b053-c2b74b5b009f None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.407578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e1a7-e8bc-4be5-b053-c2b74b5b009f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.407864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e1a7-e8bc-4be5-b053-c2b74b5b009f None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.409459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 538/1070] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:57.414896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090795-862f-4968-bf4e-48babea4a5e5 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.415184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090795-862f-4968-bf4e-48babea4a5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.415462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090795-862f-4968-bf4e-48babea4a5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.421550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf9f93-af4b-409d-9d10-af96d7e6a8f9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.433371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f0090795-862f-4968-bf4e-48babea4a5e5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:57.434911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f0090795-862f-4968-bf4e-48babea4a5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:57.441452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.461549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e70cc-3fd7-47db-a549-87751a8f0f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.462117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e70cc-3fd7-47db-a549-87751a8f0f48 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.462407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e70cc-3fd7-47db-a549-87751a8f0f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.462684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e70cc-3fd7-47db-a549-87751a8f0f48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.508107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 539/1071] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:12:57.530465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0090795-862f-4968-bf4e-48babea4a5e5 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.538541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e70cc-3fd7-47db-a549-87751a8f0f48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.540012 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e70cc-3fd7-47db-a549-87751a8f0f48 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.600179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.633049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0090795-862f-4968-bf4e-48babea4a5e5 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.650622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 533/1072] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:12:57.651689 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e70cc-3fd7-47db-a549-87751a8f0f48 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.670116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.670451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c8570-e3ad-425f-bf73-d33ed8aba3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.671105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c8570-e3ad-425f-bf73-d33ed8aba3de None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.671390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c8570-e3ad-425f-bf73-d33ed8aba3de None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.671671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c8570-e3ad-425f-bf73-d33ed8aba3de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.743140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c8570-e3ad-425f-bf73-d33ed8aba3de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.744560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c8570-e3ad-425f-bf73-d33ed8aba3de None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.756457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e70cc-3fd7-47db-a549-87751a8f0f48 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.793250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc18f-5901-4b43-88c4-701d081fd006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.794108 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc18f-5901-4b43-88c4-701d081fd006 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.794388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc18f-5901-4b43-88c4-701d081fd006 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.794660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bc18f-5901-4b43-88c4-701d081fd006 None admin] PATH_INFO: `/v3/projects/a80a6900a581472e8c33a95595f311fd` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.796082 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bc18f-5901-4b43-88c4-701d081fd006 None admin] RBAC: Authorizing `identity:get_project(project_id=a80a6900a581472e8c33a95595f311fd)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.797528 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bc18f-5901-4b43-88c4-701d081fd006 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.799433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 534/1073] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/projects/a80a6900a581472e8c33a95595f311fd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:57.805354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc18f-5901-4b43-88c4-701d081fd006 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.819758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.863260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 540/1074] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:12:57.868901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c8570-e3ad-425f-bf73-d33ed8aba3de None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.896082 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.911699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bc18f-5901-4b43-88c4-701d081fd006 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.948726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e1d94-0fc9-47c4-bef3-69306a24e509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.949375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e1d94-0fc9-47c4-bef3-69306a24e509 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.949655 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e1d94-0fc9-47c4-bef3-69306a24e509 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.949925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e1d94-0fc9-47c4-bef3-69306a24e509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.950746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e1d94-0fc9-47c4-bef3-69306a24e509 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=a80a6900a581472e8c33a95595f311fd, user.id=3dbaa024014f464e8a62ec4fe4a985d4) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:57.951058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e1d94-0fc9-47c4-bef3-69306a24e509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.952523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e1d94-0fc9-47c4-bef3-69306a24e509 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.959264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 535/1075] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/role_assignments?user.id=3dbaa024014f464e8a62ec4fe4a985d4&scope.project.id=a80a6900a581472e8c33a95595f311fd&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:57.974894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c8570-e3ad-425f-bf73-d33ed8aba3de None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:58.014995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4aaed-a3f7-46bf-a1ca-f1eb265163c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:58.016279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4aaed-a3f7-46bf-a1ca-f1eb265163c8 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:58.016795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4aaed-a3f7-46bf-a1ca-f1eb265163c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:58.017284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4aaed-a3f7-46bf-a1ca-f1eb265163c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:58.029632 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4aaed-a3f7-46bf-a1ca-f1eb265163c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:58.031118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4aaed-a3f7-46bf-a1ca-f1eb265163c8 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-faf4aaed-a3f7-46bf-a1ca-f1eb265163c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:58.051190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:58.052495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:58.053436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:58.053436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:58.053436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:58.053436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:58.053436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 541/1076] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:58.058546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e1d94-0fc9-47c4-bef3-69306a24e509 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:58.164923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e1d94-0fc9-47c4-bef3-69306a24e509 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:58.197143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93244228-35d9-4f4e-8095-899966d49a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:58.197810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93244228-35d9-4f4e-8095-899966d49a0f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:58.198097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93244228-35d9-4f4e-8095-899966d49a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:58.198375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93244228-35d9-4f4e-8095-899966d49a0f None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:58.199088 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93244228-35d9-4f4e-8095-899966d49a0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:58.199396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93244228-35d9-4f4e-8095-899966d49a0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:58.200788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93244228-35d9-4f4e-8095-899966d49a0f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:58.219995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 536/1077] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:59.418274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9807cc-eb0b-401b-959c-a66cc2811b31 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:59.418828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9807cc-eb0b-401b-959c-a66cc2811b31 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:59.418828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9807cc-eb0b-401b-959c-a66cc2811b31 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:59.420247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 542/1078] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:59.425915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335c2d8-ff9e-4ce0-b652-3baf4086290a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:59.426330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335c2d8-ff9e-4ce0-b652-3baf4086290a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:59.426481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335c2d8-ff9e-4ce0-b652-3baf4086290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:59.443162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4335c2d8-ff9e-4ce0-b652-3baf4086290a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:59.444368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4335c2d8-ff9e-4ce0-b652-3baf4086290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:59.447028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:59.509687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 537/1079] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:12:59.532245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9807cc-eb0b-401b-959c-a66cc2811b31 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:59.556375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:59.631396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9807cc-eb0b-401b-959c-a66cc2811b31 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:59.664116 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db24c0-b90f-43c3-9ccd-b4e9b9117d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:59.664927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db24c0-b90f-43c3-9ccd-b4e9b9117d60 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:59.665211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db24c0-b90f-43c3-9ccd-b4e9b9117d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:59.665487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db24c0-b90f-43c3-9ccd-b4e9b9117d60 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:59.675935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db24c0-b90f-43c3-9ccd-b4e9b9117d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-41db24c0-b90f-43c3-9ccd-b4e9b9117d60 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:59.684113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:59.685195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:12:59.686035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 543/1080] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 16 00:12:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:59.691123 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335c2d8-ff9e-4ce0-b652-3baf4086290a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:59.786222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335c2d8-ff9e-4ce0-b652-3baf4086290a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:59.818692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac806-f3a2-4dc8-be9e-a7eeb46a1e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:59.819357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac806-f3a2-4dc8-be9e-a7eeb46a1e49 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:59.819637 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac806-f3a2-4dc8-be9e-a7eeb46a1e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:59.819910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac806-f3a2-4dc8-be9e-a7eeb46a1e49 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:59.820782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac806-f3a2-4dc8-be9e-a7eeb46a1e49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:59.821089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac806-f3a2-4dc8-be9e-a7eeb46a1e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:59.822446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac806-f3a2-4dc8-be9e-a7eeb46a1e49 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:59.830297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 538/1081] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 16 00:12:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:59.835944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db24c0-b90f-43c3-9ccd-b4e9b9117d60 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:59.915021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:59.933061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db24c0-b90f-43c3-9ccd-b4e9b9117d60 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:59.965866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586dc42-ecb9-4d39-8088-26f47e4a4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:59.966654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586dc42-ecb9-4d39-8088-26f47e4a4945 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:59.966935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586dc42-ecb9-4d39-8088-26f47e4a4945 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:59.967208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586dc42-ecb9-4d39-8088-26f47e4a4945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:59.977400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586dc42-ecb9-4d39-8088-26f47e4a4945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:59.978827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586dc42-ecb9-4d39-8088-26f47e4a4945 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-5586dc42-ecb9-4d39-8088-26f47e4a4945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:59.995730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:59.996654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:59.997581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:59.997581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:59.997581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:59.997581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:13:00.000105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 544/1082] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:00.003470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac806-f3a2-4dc8-be9e-a7eeb46a1e49 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.006322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.107424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfec86-953d-48a3-be35-d744d2cbc5bf None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.107710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfec86-953d-48a3-be35-d744d2cbc5bf None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.107811 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac806-f3a2-4dc8-be9e-a7eeb46a1e49 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.108089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfec86-953d-48a3-be35-d744d2cbc5bf None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.109475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 545/1083] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:00.114342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16bdb-a8ba-4a45-b105-a4e236603457 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.114628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16bdb-a8ba-4a45-b105-a4e236603457 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.114904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a16bdb-a8ba-4a45-b105-a4e236603457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.131033 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-71a16bdb-a8ba-4a45-b105-a4e236603457 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:00.132230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-71a16bdb-a8ba-4a45-b105-a4e236603457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:00.140982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93b6c7-b6c9-42ad-942d-7522548e06de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.142169 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b6c7-b6c9-42ad-942d-7522548e06de None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.142451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b6c7-b6c9-42ad-942d-7522548e06de None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.142728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b6c7-b6c9-42ad-942d-7522548e06de None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.143446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93b6c7-b6c9-42ad-942d-7522548e06de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:00.143758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93b6c7-b6c9-42ad-942d-7522548e06de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.145210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93b6c7-b6c9-42ad-942d-7522548e06de None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.157545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 539/1084] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:00.162784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93b6c7-b6c9-42ad-942d-7522548e06de None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.197867 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 546/1085] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:13:00.220060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a16bdb-a8ba-4a45-b105-a4e236603457 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.221168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.259834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93b6c7-b6c9-42ad-942d-7522548e06de None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.280041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.292635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9ae72-305f-40cb-932f-0b29d4c8340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.293433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ae72-305f-40cb-932f-0b29d4c8340e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.293720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ae72-305f-40cb-932f-0b29d4c8340e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.294393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ae72-305f-40cb-932f-0b29d4c8340e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.302494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9ae72-305f-40cb-932f-0b29d4c8340e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.303923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9ae72-305f-40cb-932f-0b29d4c8340e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-5ff9ae72-305f-40cb-932f-0b29d4c8340e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:00.318314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:00.319359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:00.320366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:00.320366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:00.320366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:00.320366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:00.320366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:00.320366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:00.320366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:00.320366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:00.320366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:13:00.320366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:13:00.320937 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a16bdb-a8ba-4a45-b105-a4e236603457 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.321013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 540/1086] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:00.325179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9ae72-305f-40cb-932f-0b29d4c8340e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.354537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817694-c842-4994-9663-2dd4373aff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.355299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817694-c842-4994-9663-2dd4373aff22 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.355582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817694-c842-4994-9663-2dd4373aff22 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.355865 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817694-c842-4994-9663-2dd4373aff22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.365695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0817694-c842-4994-9663-2dd4373aff22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-d0817694-c842-4994-9663-2dd4373aff22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:00.373319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:00.374328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:13:00.375179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 547/1087] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:00.380951 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817694-c842-4994-9663-2dd4373aff22 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.425017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9ae72-305f-40cb-932f-0b29d4c8340e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.447157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.459124 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad903d-274a-4951-b571-9d43e58b3ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.459732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad903d-274a-4951-b571-9d43e58b3ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.460045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad903d-274a-4951-b571-9d43e58b3ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.460329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad903d-274a-4951-b571-9d43e58b3ba7 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.461172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad903d-274a-4951-b571-9d43e58b3ba7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:00.461489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad903d-274a-4951-b571-9d43e58b3ba7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.462920 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad903d-274a-4951-b571-9d43e58b3ba7 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.480389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817694-c842-4994-9663-2dd4373aff22 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.480837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 541/1088] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:00.485920 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad903d-274a-4951-b571-9d43e58b3ba7 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.504700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.515885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9777b7-c9fd-46aa-9dbb-2fe0fda25ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.517116 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9777b7-c9fd-46aa-9dbb-2fe0fda25ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.517396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9777b7-c9fd-46aa-9dbb-2fe0fda25ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.517673 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9777b7-c9fd-46aa-9dbb-2fe0fda25ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.518415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9777b7-c9fd-46aa-9dbb-2fe0fda25ac6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:00.518729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9777b7-c9fd-46aa-9dbb-2fe0fda25ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.520118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9777b7-c9fd-46aa-9dbb-2fe0fda25ac6 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.528295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 548/1089] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:00.534122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9777b7-c9fd-46aa-9dbb-2fe0fda25ac6 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.585074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad903d-274a-4951-b571-9d43e58b3ba7 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.618156 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbb0f6-deb9-4643-9c44-43373f2da078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.618801 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbb0f6-deb9-4643-9c44-43373f2da078 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.619089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbb0f6-deb9-4643-9c44-43373f2da078 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.619368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dbb0f6-deb9-4643-9c44-43373f2da078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.631477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9777b7-c9fd-46aa-9dbb-2fe0fda25ac6 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.664211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20cdce-ffd5-47eb-ac7d-870333be1da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.665074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20cdce-ffd5-47eb-ac7d-870333be1da8 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.665364 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20cdce-ffd5-47eb-ac7d-870333be1da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.665635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20cdce-ffd5-47eb-ac7d-870333be1da8 None admin] PATH_INFO: `/v3/users/3dbaa024014f464e8a62ec4fe4a985d4` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.666827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20cdce-ffd5-47eb-ac7d-870333be1da8 None admin] RBAC: Authorizing `identity:get_user(user_id=3dbaa024014f464e8a62ec4fe4a985d4)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.667772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.668451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20cdce-ffd5-47eb-ac7d-870333be1da8 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.670052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 549/1090] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/users/3dbaa024014f464e8a62ec4fe4a985d4 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:00.676262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20cdce-ffd5-47eb-ac7d-870333be1da8 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.688034 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbb0f6-deb9-4643-9c44-43373f2da078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.689475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dbb0f6-deb9-4643-9c44-43373f2da078 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.730219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.775752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20cdce-ffd5-47eb-ac7d-870333be1da8 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.788149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 542/1091] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:13:00.793765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbb0f6-deb9-4643-9c44-43373f2da078 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.809896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df7218-f78a-4ae3-ac42-28b0ec7a2d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.810759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df7218-f78a-4ae3-ac42-28b0ec7a2d93 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.811037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df7218-f78a-4ae3-ac42-28b0ec7a2d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.811313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df7218-f78a-4ae3-ac42-28b0ec7a2d93 None admin] PATH_INFO: `/v3/projects/a80a6900a581472e8c33a95595f311fd` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.812521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df7218-f78a-4ae3-ac42-28b0ec7a2d93 None admin] RBAC: Authorizing `identity:get_project(project_id=a80a6900a581472e8c33a95595f311fd)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.814614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df7218-f78a-4ae3-ac42-28b0ec7a2d93 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.816374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 550/1092] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/projects/a80a6900a581472e8c33a95595f311fd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:00.822349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df7218-f78a-4ae3-ac42-28b0ec7a2d93 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.871411 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.891652 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dbb0f6-deb9-4643-9c44-43373f2da078 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.918985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df7218-f78a-4ae3-ac42-28b0ec7a2d93 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.924577 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb35278-bf68-4c95-abfd-8e4eeb636d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.925364 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb35278-bf68-4c95-abfd-8e4eeb636d39 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.925649 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb35278-bf68-4c95-abfd-8e4eeb636d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.925928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb35278-bf68-4c95-abfd-8e4eeb636d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.935634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb35278-bf68-4c95-abfd-8e4eeb636d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.937102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb35278-bf68-4c95-abfd-8e4eeb636d39 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.940891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.952268 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd53f63-2bd9-4a3e-a82c-5cdcebdf0b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.953141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd53f63-2bd9-4a3e-a82c-5cdcebdf0b66 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.953425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd53f63-2bd9-4a3e-a82c-5cdcebdf0b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.954220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd53f63-2bd9-4a3e-a82c-5cdcebdf0b66 None admin] PATH_INFO: `/v3/projects/a80a6900a581472e8c33a95595f311fd/users/3dbaa024014f464e8a62ec4fe4a985d4/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-eeb35278-bf68-4c95-abfd-8e4eeb636d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:00.954612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:00.955580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:00.956524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:00.956524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:00.956524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:00.956524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:13:00.956524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 543/1093] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:00.957021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd53f63-2bd9-4a3e-a82c-5cdcebdf0b66 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80a6900a581472e8c33a95595f311fd, user_id=3dbaa024014f464e8a62ec4fe4a985d4, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.957619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd53f63-2bd9-4a3e-a82c-5cdcebdf0b66 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.961179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb35278-bf68-4c95-abfd-8e4eeb636d39 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.971313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 551/1094] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:00 2022] PUT /identity/v3/projects/a80a6900a581472e8c33a95595f311fd/users/3dbaa024014f464e8a62ec4fe4a985d4/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:13:01.067982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb35278-bf68-4c95-abfd-8e4eeb636d39 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:01.098332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:01.104154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c9d63-18eb-4a6b-b88a-9600d3dbaabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:01.104839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c9d63-18eb-4a6b-b88a-9600d3dbaabb None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:01.105133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c9d63-18eb-4a6b-b88a-9600d3dbaabb None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:01.105410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c9d63-18eb-4a6b-b88a-9600d3dbaabb None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.106145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c9d63-18eb-4a6b-b88a-9600d3dbaabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:01.106459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c9d63-18eb-4a6b-b88a-9600d3dbaabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:01.107847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c9d63-18eb-4a6b-b88a-9600d3dbaabb None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:01.124843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 544/1095] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:01.126331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd53f63-2bd9-4a3e-a82c-5cdcebdf0b66 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.225986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd53f63-2bd9-4a3e-a82c-5cdcebdf0b66 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:01.258714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a7d0b-b3ab-4b7b-9d9b-c0e6624d85c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:01.259507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a7d0b-b3ab-4b7b-9d9b-c0e6624d85c1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:01.259795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a7d0b-b3ab-4b7b-9d9b-c0e6624d85c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:01.260107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a7d0b-b3ab-4b7b-9d9b-c0e6624d85c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.266791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a7d0b-b3ab-4b7b-9d9b-c0e6624d85c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:01.268294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a7d0b-b3ab-4b7b-9d9b-c0e6624d85c1 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-331a7d0b-b3ab-4b7b-9d9b-c0e6624d85c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:01.284571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:01.285650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:01.286930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:01.286930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:01.286930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:01.286930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:01.286930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:01.286930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:01.286930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:01.286930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:13:01.286930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 552/1096] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:01.293470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c9d63-18eb-4a6b-b88a-9600d3dbaabb None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.394437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c9d63-18eb-4a6b-b88a-9600d3dbaabb None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:01.426845 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792bcc0-1581-46a6-ad55-dca2c0274424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:01.427504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792bcc0-1581-46a6-ad55-dca2c0274424 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:01.427792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792bcc0-1581-46a6-ad55-dca2c0274424 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:01.428104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792bcc0-1581-46a6-ad55-dca2c0274424 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.428907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792bcc0-1581-46a6-ad55-dca2c0274424 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:01.429222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792bcc0-1581-46a6-ad55-dca2c0274424 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:01.430641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792bcc0-1581-46a6-ad55-dca2c0274424 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:01.443848 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 545/1097] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:01.449763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a7d0b-b3ab-4b7b-9d9b-c0e6624d85c1 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.493071 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:01.549084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a7d0b-b3ab-4b7b-9d9b-c0e6624d85c1 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:01.581170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765170b-222c-4037-bfb0-7c99196a653f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:01.581810 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765170b-222c-4037-bfb0-7c99196a653f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:01.582090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765170b-222c-4037-bfb0-7c99196a653f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:01.582364 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765170b-222c-4037-bfb0-7c99196a653f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.583181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765170b-222c-4037-bfb0-7c99196a653f None admin] RBAC: Adding query filter params (role.id=ae85f17673084352ab9b3953669ab67e, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=cd57046b084b463488296b825097081d) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:01.583493 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765170b-222c-4037-bfb0-7c99196a653f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:01.584946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765170b-222c-4037-bfb0-7c99196a653f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:01.591159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 553/1098] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/role_assignments?user.id=cd57046b084b463488296b825097081d&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=ae85f17673084352ab9b3953669ab67e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:03.093967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a929a78-a0d6-48ad-9616-f27731f6c1f7 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:03.094551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a929a78-a0d6-48ad-9616-f27731f6c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:03.094551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a929a78-a0d6-48ad-9616-f27731f6c1f7 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:03.096508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 546/1099] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:03.101469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb43f3-c6a7-4482-875d-d8f4240e06e9 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:03.101871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb43f3-c6a7-4482-875d-d8f4240e06e9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:03.102018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb43f3-c6a7-4482-875d-d8f4240e06e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:03.118085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-83eb43f3-c6a7-4482-875d-d8f4240e06e9 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:03.119278 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-83eb43f3-c6a7-4482-875d-d8f4240e06e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:03.182763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 554/1100] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:03.205991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a929a78-a0d6-48ad-9616-f27731f6c1f7 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:03.258522 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:03.308571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a929a78-a0d6-48ad-9616-f27731f6c1f7 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:03.342627 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8e7f7-66ea-41e9-bea5-5a1cc8ef6572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:03.343405 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8e7f7-66ea-41e9-bea5-5a1cc8ef6572 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:03.343688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8e7f7-66ea-41e9-bea5-5a1cc8ef6572 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:03.343978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8e7f7-66ea-41e9-bea5-5a1cc8ef6572 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:03.353782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8e7f7-66ea-41e9-bea5-5a1cc8ef6572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-91a8e7f7-66ea-41e9-bea5-5a1cc8ef6572 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:03.361891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:03.363114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:13:03.364078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 547/1101] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:03.368940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb43f3-c6a7-4482-875d-d8f4240e06e9 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:03.402290 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:03.463827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb43f3-c6a7-4482-875d-d8f4240e06e9 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:03.496726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8887f5-3bbc-425f-9371-14ba828a4bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:03.497374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8887f5-3bbc-425f-9371-14ba828a4bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:03.497657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8887f5-3bbc-425f-9371-14ba828a4bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:03.497933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8887f5-3bbc-425f-9371-14ba828a4bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:03.498665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8887f5-3bbc-425f-9371-14ba828a4bf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:03.498973 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8887f5-3bbc-425f-9371-14ba828a4bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:03.500347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8887f5-3bbc-425f-9371-14ba828a4bf5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:03.508141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 555/1102] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:03.513843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8e7f7-66ea-41e9-bea5-5a1cc8ef6572 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:03.611680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8e7f7-66ea-41e9-bea5-5a1cc8ef6572 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:03.623925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:03.644508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da5756-48af-4957-9dad-036ea3734c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:03.645370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da5756-48af-4957-9dad-036ea3734c22 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:03.645649 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da5756-48af-4957-9dad-036ea3734c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:03.645926 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da5756-48af-4957-9dad-036ea3734c22 None admin] PATH_INFO: `/v3/users/3dbaa024014f464e8a62ec4fe4a985d4` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:03.647092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da5756-48af-4957-9dad-036ea3734c22 None admin] RBAC: Authorizing `identity:get_user(user_id=3dbaa024014f464e8a62ec4fe4a985d4)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:03.648552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da5756-48af-4957-9dad-036ea3734c22 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:03.650164 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 548/1103] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:03 2022] GET /identity/v3/users/3dbaa024014f464e8a62ec4fe4a985d4 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:03.655894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8887f5-3bbc-425f-9371-14ba828a4bf5 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:03.748212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:03.751946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8887f5-3bbc-425f-9371-14ba828a4bf5 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:03.784822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b3201-b0f6-4898-9496-16d8b9105963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:03.785457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b3201-b0f6-4898-9496-16d8b9105963 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:03.785739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b3201-b0f6-4898-9496-16d8b9105963 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:03.786016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b3201-b0f6-4898-9496-16d8b9105963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:03.850055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b3201-b0f6-4898-9496-16d8b9105963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:03.851472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b3201-b0f6-4898-9496-16d8b9105963 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:03.939656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:03.944475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 556/1104] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:13:03.950239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da5756-48af-4957-9dad-036ea3734c22 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:04.049614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da5756-48af-4957-9dad-036ea3734c22 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:04.081298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d130c-75b8-42b3-9a0f-beb22aad3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:04.082150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d130c-75b8-42b3-9a0f-beb22aad3379 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.082428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d130c-75b8-42b3-9a0f-beb22aad3379 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.082699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d130c-75b8-42b3-9a0f-beb22aad3379 None admin] PATH_INFO: `/v3/projects/a80a6900a581472e8c33a95595f311fd` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.083851 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d130c-75b8-42b3-9a0f-beb22aad3379 None admin] RBAC: Authorizing `identity:get_project(project_id=a80a6900a581472e8c33a95595f311fd)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:04.085296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d130c-75b8-42b3-9a0f-beb22aad3379 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:04.086958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 549/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:03 2022] GET /identity/v3/projects/a80a6900a581472e8c33a95595f311fd => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:04.093315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b3201-b0f6-4898-9496-16d8b9105963 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:04.187522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b3201-b0f6-4898-9496-16d8b9105963 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:04.220289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94db0fc-115d-4318-8466-495c6e0b15cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:04.220867 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db0fc-115d-4318-8466-495c6e0b15cb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.221149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db0fc-115d-4318-8466-495c6e0b15cb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.221424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db0fc-115d-4318-8466-495c6e0b15cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.222234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94db0fc-115d-4318-8466-495c6e0b15cb None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=a80a6900a581472e8c33a95595f311fd, user.id=3dbaa024014f464e8a62ec4fe4a985d4) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:04.222548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94db0fc-115d-4318-8466-495c6e0b15cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:04.223953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94db0fc-115d-4318-8466-495c6e0b15cb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:04.229537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 557/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:04 2022] GET /identity/v3/role_assignments?user.id=3dbaa024014f464e8a62ec4fe4a985d4&scope.project.id=a80a6900a581472e8c33a95595f311fd&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:06.363793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca93cd7-e6ff-4fc2-9c4f-c8cfa2895e11 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:06.364355 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca93cd7-e6ff-4fc2-9c4f-c8cfa2895e11 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:06.364457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca93cd7-e6ff-4fc2-9c4f-c8cfa2895e11 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:06.365765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 550/1107] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:06.370935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f6dda-e7e9-4b11-891a-9837df19047c None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:06.371349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f6dda-e7e9-4b11-891a-9837df19047c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:06.371606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f6dda-e7e9-4b11-891a-9837df19047c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:06.388391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-469f6dda-e7e9-4b11-891a-9837df19047c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:06.389551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-469f6dda-e7e9-4b11-891a-9837df19047c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:06.443037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:06.453133 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 558/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:06.477755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca93cd7-e6ff-4fc2-9c4f-c8cfa2895e11 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:06.526260 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:06.576741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca93cd7-e6ff-4fc2-9c4f-c8cfa2895e11 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:06.609552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96205147-6c23-485d-87be-38a45dc28783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:06.610886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205147-6c23-485d-87be-38a45dc28783 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:06.611168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205147-6c23-485d-87be-38a45dc28783 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:06.611443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205147-6c23-485d-87be-38a45dc28783 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:06.612610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96205147-6c23-485d-87be-38a45dc28783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:06.614086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96205147-6c23-485d-87be-38a45dc28783 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:06.615636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 551/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:06.621105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f6dda-e7e9-4b11-891a-9837df19047c None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:06.717847 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f6dda-e7e9-4b11-891a-9837df19047c None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:06.754566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ad37a-3d2e-432a-a6e4-8141c0cc1b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:06.755233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ad37a-3d2e-432a-a6e4-8141c0cc1b69 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:06.755516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ad37a-3d2e-432a-a6e4-8141c0cc1b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:06.755796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ad37a-3d2e-432a-a6e4-8141c0cc1b69 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:06.756529 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ad37a-3d2e-432a-a6e4-8141c0cc1b69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:06.757952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ad37a-3d2e-432a-a6e4-8141c0cc1b69 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:06.777461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 559/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:06 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:08.924210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199765a-7796-4678-ab48-b40950dfe4f4 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.924775 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199765a-7796-4678-ab48-b40950dfe4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.924775 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199765a-7796-4678-ab48-b40950dfe4f4 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.926221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 552/1111] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:08.931475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb0366-e125-463f-9e19-b66efc8753fb None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.931879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb0366-e125-463f-9e19-b66efc8753fb None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.932069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb0366-e125-463f-9e19-b66efc8753fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.948930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-fdcb0366-e125-463f-9e19-b66efc8753fb None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:08.950112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fdcb0366-e125-463f-9e19-b66efc8753fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:08.992728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:09.016428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 560/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:09.039557 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199765a-7796-4678-ab48-b40950dfe4f4 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.136579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199765a-7796-4678-ab48-b40950dfe4f4 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.151859 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:09.168727 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b735eb-6f17-470b-ac48-d4193ec3afc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.169567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b735eb-6f17-470b-ac48-d4193ec3afc2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.169849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b735eb-6f17-470b-ac48-d4193ec3afc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.170123 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b735eb-6f17-470b-ac48-d4193ec3afc2 None admin] PATH_INFO: `/v3/roles/bad10ed55f6140b882d1fdd6994f1fa8` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.171572 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b735eb-6f17-470b-ac48-d4193ec3afc2 None admin] RBAC: Authorizing `identity:get_role(role_id=bad10ed55f6140b882d1fdd6994f1fa8)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.173462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b735eb-6f17-470b-ac48-d4193ec3afc2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.174834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 553/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:09 2022] GET /identity/v3/roles/bad10ed55f6140b882d1fdd6994f1fa8 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:09.180503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb0366-e125-463f-9e19-b66efc8753fb None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.275096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb0366-e125-463f-9e19-b66efc8753fb None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.307447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48032a68-d889-4186-a337-fe6a571875f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.308341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48032a68-d889-4186-a337-fe6a571875f9 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.308628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48032a68-d889-4186-a337-fe6a571875f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.308905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48032a68-d889-4186-a337-fe6a571875f9 None admin] PATH_INFO: `/v3/users/2cae713871184c7dace9530a7b2cbae2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.322061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48032a68-d889-4186-a337-fe6a571875f9 None admin] RBAC: Authorizing `identity:get_user(user_id=2cae713871184c7dace9530a7b2cbae2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.323494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48032a68-d889-4186-a337-fe6a571875f9 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.325150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 561/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:09 2022] GET /identity/v3/users/2cae713871184c7dace9530a7b2cbae2 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:09.330795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b735eb-6f17-470b-ac48-d4193ec3afc2 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.426426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b735eb-6f17-470b-ac48-d4193ec3afc2 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.459094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783c448-136c-4bc5-b92a-9c17d8778c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.459728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783c448-136c-4bc5-b92a-9c17d8778c7c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.460038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783c448-136c-4bc5-b92a-9c17d8778c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.460320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783c448-136c-4bc5-b92a-9c17d8778c7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.509075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:09.524626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783c448-136c-4bc5-b92a-9c17d8778c7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.526056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783c448-136c-4bc5-b92a-9c17d8778c7c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.620054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 554/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:13:09.626035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48032a68-d889-4186-a337-fe6a571875f9 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.659372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:09.721659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48032a68-d889-4186-a337-fe6a571875f9 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.754532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ef92a-4dc0-4eea-97e4-351ede1c4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.755384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef92a-4dc0-4eea-97e4-351ede1c4ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.755670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef92a-4dc0-4eea-97e4-351ede1c4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.755950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ef92a-4dc0-4eea-97e4-351ede1c4ac7 None admin] PATH_INFO: `/v3/projects/a80a6900a581472e8c33a95595f311fd` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.757150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ef92a-4dc0-4eea-97e4-351ede1c4ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=a80a6900a581472e8c33a95595f311fd)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.758568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ef92a-4dc0-4eea-97e4-351ede1c4ac7 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.760278 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 562/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:09 2022] GET /identity/v3/projects/a80a6900a581472e8c33a95595f311fd => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:09.767099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783c448-136c-4bc5-b92a-9c17d8778c7c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.847186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:09.862405 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783c448-136c-4bc5-b92a-9c17d8778c7c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.894769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312cefcc-1d9f-420a-98b0-f2dc97fcd1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.895409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cefcc-1d9f-420a-98b0-f2dc97fcd1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.895692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cefcc-1d9f-420a-98b0-f2dc97fcd1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.895994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312cefcc-1d9f-420a-98b0-f2dc97fcd1a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.896816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cefcc-1d9f-420a-98b0-f2dc97fcd1a3 None admin] RBAC: Adding query filter params (role.id=bad10ed55f6140b882d1fdd6994f1fa8, scope.project.id=a80a6900a581472e8c33a95595f311fd, user.id=2cae713871184c7dace9530a7b2cbae2) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:09.897131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cefcc-1d9f-420a-98b0-f2dc97fcd1a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.898554 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312cefcc-1d9f-420a-98b0-f2dc97fcd1a3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.903803 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 555/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:09 2022] GET /identity/v3/role_assignments?user.id=2cae713871184c7dace9530a7b2cbae2&scope.project.id=a80a6900a581472e8c33a95595f311fd&role.id=bad10ed55f6140b882d1fdd6994f1fa8 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:11.972113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e1c1e-c0f1-438f-baf2-51a4ffa23b56 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.972675 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e1c1e-c0f1-438f-baf2-51a4ffa23b56 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.972675 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e1c1e-c0f1-438f-baf2-51a4ffa23b56 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.974016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 563/1118] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:11.979268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35817e-9a44-420c-b2f1-886e7be72fcf None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.979661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35817e-9a44-420c-b2f1-886e7be72fcf None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.979883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35817e-9a44-420c-b2f1-886e7be72fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.996767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-3f35817e-9a44-420c-b2f1-886e7be72fcf None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:11.997943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3f35817e-9a44-420c-b2f1-886e7be72fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:12.062884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 556/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:13:12.085189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e1c1e-c0f1-438f-baf2-51a4ffa23b56 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:12.182509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e1c1e-c0f1-438f-baf2-51a4ffa23b56 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:12.184750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:12.215370 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee8343-1faa-4310-940b-454902738957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:12.216240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee8343-1faa-4310-940b-454902738957 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.216524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee8343-1faa-4310-940b-454902738957 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.216797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee8343-1faa-4310-940b-454902738957 None admin] PATH_INFO: `/v3/roles/bad10ed55f6140b882d1fdd6994f1fa8` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.218258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee8343-1faa-4310-940b-454902738957 None admin] RBAC: Authorizing `identity:get_role(role_id=bad10ed55f6140b882d1fdd6994f1fa8)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:12.220251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee8343-1faa-4310-940b-454902738957 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:12.221590 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 564/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:12 2022] GET /identity/v3/roles/bad10ed55f6140b882d1fdd6994f1fa8 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:12.227378 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35817e-9a44-420c-b2f1-886e7be72fcf None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:12.301504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:12.321943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35817e-9a44-420c-b2f1-886e7be72fcf None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:12.354778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac69f2-1f33-4e9b-81e4-29e18b4a4b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:12.355629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac69f2-1f33-4e9b-81e4-29e18b4a4b77 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.355908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac69f2-1f33-4e9b-81e4-29e18b4a4b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.356206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac69f2-1f33-4e9b-81e4-29e18b4a4b77 None admin] PATH_INFO: `/v3/users/2cae713871184c7dace9530a7b2cbae2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.357390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac69f2-1f33-4e9b-81e4-29e18b4a4b77 None admin] RBAC: Authorizing `identity:get_user(user_id=2cae713871184c7dace9530a7b2cbae2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:12.358809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac69f2-1f33-4e9b-81e4-29e18b4a4b77 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:12.360469 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 557/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:12 2022] GET /identity/v3/users/2cae713871184c7dace9530a7b2cbae2 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:12.365916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee8343-1faa-4310-940b-454902738957 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:12.461075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee8343-1faa-4310-940b-454902738957 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:12.493058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd29e49-b325-4698-97b9-7f55474584bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:12.493850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd29e49-b325-4698-97b9-7f55474584bc None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.494131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd29e49-b325-4698-97b9-7f55474584bc None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.494404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd29e49-b325-4698-97b9-7f55474584bc None admin] PATH_INFO: `/v3/projects/a80a6900a581472e8c33a95595f311fd` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.495568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd29e49-b325-4698-97b9-7f55474584bc None admin] RBAC: Authorizing `identity:get_project(project_id=a80a6900a581472e8c33a95595f311fd)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:12.497018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd29e49-b325-4698-97b9-7f55474584bc None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:12.498664 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 565/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:12 2022] GET /identity/v3/projects/a80a6900a581472e8c33a95595f311fd => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:12.504655 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac69f2-1f33-4e9b-81e4-29e18b4a4b77 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:12.598910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac69f2-1f33-4e9b-81e4-29e18b4a4b77 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:12.631536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f5e1b-e597-4bab-a696-d21e8e825998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:12.632415 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f5e1b-e597-4bab-a696-d21e8e825998 None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.632697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f5e1b-e597-4bab-a696-d21e8e825998 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.632969 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f5e1b-e597-4bab-a696-d21e8e825998 None admin] PATH_INFO: `/v3/projects/a80a6900a581472e8c33a95595f311fd/users/2cae713871184c7dace9530a7b2cbae2/roles/bad10ed55f6140b882d1fdd6994f1fa8` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.635110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f5e1b-e597-4bab-a696-d21e8e825998 None admin] RBAC: Authorizing `identity:create_grant(project_id=a80a6900a581472e8c33a95595f311fd, user_id=2cae713871184c7dace9530a7b2cbae2, role_id=bad10ed55f6140b882d1fdd6994f1fa8)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:12.636550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f5e1b-e597-4bab-a696-d21e8e825998 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:12.648565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 558/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:12 2022] PUT /identity/v3/projects/a80a6900a581472e8c33a95595f311fd/users/2cae713871184c7dace9530a7b2cbae2/roles/bad10ed55f6140b882d1fdd6994f1fa8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:14.717029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae14a-5cd0-4b76-913c-1be3d4b82616 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.717610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae14a-5cd0-4b76-913c-1be3d4b82616 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.717610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ae14a-5cd0-4b76-913c-1be3d4b82616 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.719439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 566/1124] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:14.724588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b39be-9c16-4f6c-b712-46a0b4f2b941 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.724980 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b39be-9c16-4f6c-b712-46a0b4f2b941 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.725150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b39be-9c16-4f6c-b712-46a0b4f2b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.736549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:14.742528 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-029b39be-9c16-4f6c-b712-46a0b4f2b941 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:14.744183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-029b39be-9c16-4f6c-b712-46a0b4f2b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:14.807895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 559/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:14.830806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ae14a-5cd0-4b76-913c-1be3d4b82616 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:14.873689 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:14.930718 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ae14a-5cd0-4b76-913c-1be3d4b82616 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:14.962553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672ce5-a0ae-4544-bbd0-761480277909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:14.963402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672ce5-a0ae-4544-bbd0-761480277909 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.963686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672ce5-a0ae-4544-bbd0-761480277909 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.963993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672ce5-a0ae-4544-bbd0-761480277909 None admin] PATH_INFO: `/v3/roles/bad10ed55f6140b882d1fdd6994f1fa8` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.965716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4672ce5-a0ae-4544-bbd0-761480277909 None admin] RBAC: Authorizing `identity:get_role(role_id=bad10ed55f6140b882d1fdd6994f1fa8)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:14.967128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4672ce5-a0ae-4544-bbd0-761480277909 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:14.968457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 567/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:14 2022] GET /identity/v3/roles/bad10ed55f6140b882d1fdd6994f1fa8 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:14.974732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b39be-9c16-4f6c-b712-46a0b4f2b941 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:15.070554 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b39be-9c16-4f6c-b712-46a0b4f2b941 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:15.103674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714fd5-b44e-4161-81e7-20c6c9163abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:15.104565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714fd5-b44e-4161-81e7-20c6c9163abf None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:15.104851 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714fd5-b44e-4161-81e7-20c6c9163abf None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:15.105126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76714fd5-b44e-4161-81e7-20c6c9163abf None admin] PATH_INFO: `/v3/users/2cae713871184c7dace9530a7b2cbae2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:15.106300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76714fd5-b44e-4161-81e7-20c6c9163abf None admin] RBAC: Authorizing `identity:get_user(user_id=2cae713871184c7dace9530a7b2cbae2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:15.107714 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76714fd5-b44e-4161-81e7-20c6c9163abf None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:15.109856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 560/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:14 2022] GET /identity/v3/users/2cae713871184c7dace9530a7b2cbae2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:15.115477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672ce5-a0ae-4544-bbd0-761480277909 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:15.210133 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672ce5-a0ae-4544-bbd0-761480277909 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:15.219243 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:15.243739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f1c4-fd08-4aa2-a3da-83cbbc4a2d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:15.244399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f1c4-fd08-4aa2-a3da-83cbbc4a2d43 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:15.244686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f1c4-fd08-4aa2-a3da-83cbbc4a2d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:15.244964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f1c4-fd08-4aa2-a3da-83cbbc4a2d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:15.308659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554f1c4-fd08-4aa2-a3da-83cbbc4a2d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:15.310081 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554f1c4-fd08-4aa2-a3da-83cbbc4a2d43 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:15.403337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 568/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:13:15.409633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714fd5-b44e-4161-81e7-20c6c9163abf None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:15.413278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:15.504275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76714fd5-b44e-4161-81e7-20c6c9163abf None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:15.536207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c71983-6c06-4b70-a40b-d0601496b3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:15.537038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c71983-6c06-4b70-a40b-d0601496b3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:15.537319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c71983-6c06-4b70-a40b-d0601496b3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:15.537594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c71983-6c06-4b70-a40b-d0601496b3a1 None admin] PATH_INFO: `/v3/projects/a80a6900a581472e8c33a95595f311fd` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:15.538746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c71983-6c06-4b70-a40b-d0601496b3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=a80a6900a581472e8c33a95595f311fd)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:15.540183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c71983-6c06-4b70-a40b-d0601496b3a1 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:15.541825 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 561/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:15 2022] GET /identity/v3/projects/a80a6900a581472e8c33a95595f311fd => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:15.548348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f1c4-fd08-4aa2-a3da-83cbbc4a2d43 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:15.558103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:15.643265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f1c4-fd08-4aa2-a3da-83cbbc4a2d43 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:15.675352 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a16f82-33dc-45db-878b-ee704ef44a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:15.676004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a16f82-33dc-45db-878b-ee704ef44a30 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:15.676286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a16f82-33dc-45db-878b-ee704ef44a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:15.676561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a16f82-33dc-45db-878b-ee704ef44a30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:15.677374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a16f82-33dc-45db-878b-ee704ef44a30 None admin] RBAC: Adding query filter params (role.id=bad10ed55f6140b882d1fdd6994f1fa8, scope.project.id=a80a6900a581472e8c33a95595f311fd, user.id=2cae713871184c7dace9530a7b2cbae2) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:15.677691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a16f82-33dc-45db-878b-ee704ef44a30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:15.679093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a16f82-33dc-45db-878b-ee704ef44a30 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:15.684706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 569/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:15 2022] GET /identity/v3/role_assignments?user.id=2cae713871184c7dace9530a7b2cbae2&scope.project.id=a80a6900a581472e8c33a95595f311fd&role.id=bad10ed55f6140b882d1fdd6994f1fa8 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:17.784160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e53fa-c871-4f9d-bdbc-91864ccae762 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:17.784709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e53fa-c871-4f9d-bdbc-91864ccae762 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:17.784709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e53fa-c871-4f9d-bdbc-91864ccae762 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:17.786066 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 562/1131] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:17.791074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e3892-c6ab-49ca-9a6c-1a560637403d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:17.791507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e3892-c6ab-49ca-9a6c-1a560637403d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:17.791633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e3892-c6ab-49ca-9a6c-1a560637403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:17.808391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b42e3892-c6ab-49ca-9a6c-1a560637403d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:17.809560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b42e3892-c6ab-49ca-9a6c-1a560637403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:17.873120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 570/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:17.895547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e53fa-c871-4f9d-bdbc-91864ccae762 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:17.962529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:17.991724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e53fa-c871-4f9d-bdbc-91864ccae762 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:18.025531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cae81e-16b3-4dfc-8471-6278b8fcd835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:18.026318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cae81e-16b3-4dfc-8471-6278b8fcd835 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:18.026606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cae81e-16b3-4dfc-8471-6278b8fcd835 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:18.026885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cae81e-16b3-4dfc-8471-6278b8fcd835 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:18.028086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cae81e-16b3-4dfc-8471-6278b8fcd835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:18.029517 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cae81e-16b3-4dfc-8471-6278b8fcd835 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:18.031746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 563/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:18.037609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e3892-c6ab-49ca-9a6c-1a560637403d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:18.039697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:18.130901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e3892-c6ab-49ca-9a6c-1a560637403d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:18.163323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa17da7-3440-4a92-b8d3-246559ddafc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:18.163993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17da7-3440-4a92-b8d3-246559ddafc6 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:18.164274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17da7-3440-4a92-b8d3-246559ddafc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:18.164550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa17da7-3440-4a92-b8d3-246559ddafc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:18.165252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa17da7-3440-4a92-b8d3-246559ddafc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:18.166654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa17da7-3440-4a92-b8d3-246559ddafc6 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:18.192070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 571/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:13:18 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:13:20.316347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6df7c-5ed1-4075-b988-42b430d6cf85 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.316865 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6df7c-5ed1-4075-b988-42b430d6cf85 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.316865 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6df7c-5ed1-4075-b988-42b430d6cf85 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.318170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 564/1135] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:20.323512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236e3d3-ccb9-4465-a615-c06575ef5a7e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.323899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236e3d3-ccb9-4465-a615-c06575ef5a7e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.324110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236e3d3-ccb9-4465-a615-c06575ef5a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.341030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-1236e3d3-ccb9-4465-a615-c06575ef5a7e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:20.342189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1236e3d3-ccb9-4465-a615-c06575ef5a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:20.388706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:20.407129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 572/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:20.432270 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6df7c-5ed1-4075-b988-42b430d6cf85 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:20.528786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6df7c-5ed1-4075-b988-42b430d6cf85 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:20.561301 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1ed16-5b59-4f1a-af94-8e8900925b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.562064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1ed16-5b59-4f1a-af94-8e8900925b3c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.562369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1ed16-5b59-4f1a-af94-8e8900925b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.562646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1ed16-5b59-4f1a-af94-8e8900925b3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.563797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1ed16-5b59-4f1a-af94-8e8900925b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:20.565239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1ed16-5b59-4f1a-af94-8e8900925b3c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:20.566851 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 565/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:20.572376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236e3d3-ccb9-4465-a615-c06575ef5a7e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:20.666970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236e3d3-ccb9-4465-a615-c06575ef5a7e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:20.701930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c68c1b-5cce-4f90-87c4-9c7d966f5fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.702579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c68c1b-5cce-4f90-87c4-9c7d966f5fd0 None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.703485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c68c1b-5cce-4f90-87c4-9c7d966f5fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.703764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c68c1b-5cce-4f90-87c4-9c7d966f5fd0 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.704495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c68c1b-5cce-4f90-87c4-9c7d966f5fd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:20.705905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c68c1b-5cce-4f90-87c4-9c7d966f5fd0 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:20.725784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 573/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:20 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:22.833679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd058a6-d4e1-44de-a0d4-183da0c8ebc1 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:22.834253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd058a6-d4e1-44de-a0d4-183da0c8ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:22.834253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd058a6-d4e1-44de-a0d4-183da0c8ebc1 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:22.835602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 566/1139] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:22.841032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fbce7-f4ca-4f42-9d83-08edb9c768a0 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:22.841404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fbce7-f4ca-4f42-9d83-08edb9c768a0 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:22.841625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fbce7-f4ca-4f42-9d83-08edb9c768a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:22.858334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4d8fbce7-f4ca-4f42-9d83-08edb9c768a0 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:22.859666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4d8fbce7-f4ca-4f42-9d83-08edb9c768a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:22.893433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:22.925325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 574/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:22.948185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd058a6-d4e1-44de-a0d4-183da0c8ebc1 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:22.958782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:23.046566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd058a6-d4e1-44de-a0d4-183da0c8ebc1 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:23.079751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2d4aa-9592-471a-9d87-09464e901263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:23.080556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d4aa-9592-471a-9d87-09464e901263 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.080839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d4aa-9592-471a-9d87-09464e901263 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.081110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d4aa-9592-471a-9d87-09464e901263 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.090949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2d4aa-9592-471a-9d87-09464e901263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-f4a2d4aa-9592-471a-9d87-09464e901263 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:23.098562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:23.099694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:13:23.105018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 567/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:23.105777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fbce7-f4ca-4f42-9d83-08edb9c768a0 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:23.199074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fbce7-f4ca-4f42-9d83-08edb9c768a0 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:23.231362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db582f-6b3e-48cd-bb38-6fd196c27a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:23.232030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db582f-6b3e-48cd-bb38-6fd196c27a42 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.232315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db582f-6b3e-48cd-bb38-6fd196c27a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.232589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db582f-6b3e-48cd-bb38-6fd196c27a42 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.233326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db582f-6b3e-48cd-bb38-6fd196c27a42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:23.233631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db582f-6b3e-48cd-bb38-6fd196c27a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:23.236545 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db582f-6b3e-48cd-bb38-6fd196c27a42 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:23.244252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 575/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:23.250646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2d4aa-9592-471a-9d87-09464e901263 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:23.314829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:23.347132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2d4aa-9592-471a-9d87-09464e901263 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:23.379462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956773-ecf8-48ca-a1e1-bb1fae2a871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:23.380351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956773-ecf8-48ca-a1e1-bb1fae2a871e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.380635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956773-ecf8-48ca-a1e1-bb1fae2a871e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.380908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956773-ecf8-48ca-a1e1-bb1fae2a871e None admin] PATH_INFO: `/v3/users/89763e88c29d432f9c32f06100d51f13` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.393902 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef956773-ecf8-48ca-a1e1-bb1fae2a871e None admin] RBAC: Authorizing `identity:get_user(user_id=89763e88c29d432f9c32f06100d51f13)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:23.395322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef956773-ecf8-48ca-a1e1-bb1fae2a871e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:23.396959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 568/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:23 2022] GET /identity/v3/users/89763e88c29d432f9c32f06100d51f13 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:23.402640 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db582f-6b3e-48cd-bb38-6fd196c27a42 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:23.432963 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:23.497744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db582f-6b3e-48cd-bb38-6fd196c27a42 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:23.529250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134c56d-d718-4fe9-ad01-dc7b566743bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:23.529876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134c56d-d718-4fe9-ad01-dc7b566743bb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.530157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134c56d-d718-4fe9-ad01-dc7b566743bb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.530432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134c56d-d718-4fe9-ad01-dc7b566743bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.593970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134c56d-d718-4fe9-ad01-dc7b566743bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:23.595388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134c56d-d718-4fe9-ad01-dc7b566743bb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:23.624434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:23.697440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 576/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:13:23.703282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956773-ecf8-48ca-a1e1-bb1fae2a871e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:23.797814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956773-ecf8-48ca-a1e1-bb1fae2a871e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:23.822262 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:23.830909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108019b0-e39d-4039-bbae-e7e45260e788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:23.831756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108019b0-e39d-4039-bbae-e7e45260e788 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.832085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108019b0-e39d-4039-bbae-e7e45260e788 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.832363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108019b0-e39d-4039-bbae-e7e45260e788 None admin] PATH_INFO: `/v3/projects/db6f9f60396b411395c226853dbb4560` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.833539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108019b0-e39d-4039-bbae-e7e45260e788 None admin] RBAC: Authorizing `identity:get_project(project_id=db6f9f60396b411395c226853dbb4560)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:23.834972 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108019b0-e39d-4039-bbae-e7e45260e788 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:23.836674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 569/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:23 2022] GET /identity/v3/projects/db6f9f60396b411395c226853dbb4560 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:23.842827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134c56d-d718-4fe9-ad01-dc7b566743bb None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:23.939550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134c56d-d718-4fe9-ad01-dc7b566743bb None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:23.983195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:23.989060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12df46a-1278-49ad-9c58-7d5a1bee8b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:23.989705 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12df46a-1278-49ad-9c58-7d5a1bee8b76 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.989988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12df46a-1278-49ad-9c58-7d5a1bee8b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.990263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12df46a-1278-49ad-9c58-7d5a1bee8b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.991079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12df46a-1278-49ad-9c58-7d5a1bee8b76 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=db6f9f60396b411395c226853dbb4560, user.id=89763e88c29d432f9c32f06100d51f13) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:23.991394 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12df46a-1278-49ad-9c58-7d5a1bee8b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:23.992845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12df46a-1278-49ad-9c58-7d5a1bee8b76 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:23.998244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 577/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:23 2022] GET /identity/v3/role_assignments?user.id=89763e88c29d432f9c32f06100d51f13&scope.project.id=db6f9f60396b411395c226853dbb4560&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:26.077263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b23fa-9033-47e0-bf2b-5c4e53893a4a None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.078403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b23fa-9033-47e0-bf2b-5c4e53893a4a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.078403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b23fa-9033-47e0-bf2b-5c4e53893a4a None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.079707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 570/1147] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:26.084882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e075-0b8c-46b2-9204-ad76839fd8f2 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.085283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e075-0b8c-46b2-9204-ad76839fd8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.085450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4e075-0b8c-46b2-9204-ad76839fd8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.102283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-09f4e075-0b8c-46b2-9204-ad76839fd8f2 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:26.103464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-09f4e075-0b8c-46b2-9204-ad76839fd8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:26.167098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 578/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:26.190079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b23fa-9033-47e0-bf2b-5c4e53893a4a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:26.290137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b23fa-9033-47e0-bf2b-5c4e53893a4a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:26.322697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b55f-a0b1-4620-aaae-31c80577aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:26.323481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b55f-a0b1-4620-aaae-31c80577aeae None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.323761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b55f-a0b1-4620-aaae-31c80577aeae None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.324059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b55f-a0b1-4620-aaae-31c80577aeae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.333694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4b55f-a0b1-4620-aaae-31c80577aeae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-89b4b55f-a0b1-4620-aaae-31c80577aeae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:26.341567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:26.342654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:13:26.343678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 571/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:26.348963 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4e075-0b8c-46b2-9204-ad76839fd8f2 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:26.443438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4e075-0b8c-46b2-9204-ad76839fd8f2 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:26.468407 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:26.477076 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9a2bd-8ec8-4895-8b19-d4108b31c6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:26.477724 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9a2bd-8ec8-4895-8b19-d4108b31c6df None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.478007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9a2bd-8ec8-4895-8b19-d4108b31c6df None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.478283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9a2bd-8ec8-4895-8b19-d4108b31c6df None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.479017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9a2bd-8ec8-4895-8b19-d4108b31c6df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:26.479339 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9a2bd-8ec8-4895-8b19-d4108b31c6df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:26.480701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9a2bd-8ec8-4895-8b19-d4108b31c6df None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:26.488981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 579/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:26.494541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b55f-a0b1-4620-aaae-31c80577aeae None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:26.547740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:26.590872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b55f-a0b1-4620-aaae-31c80577aeae None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:26.622556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac9fc-9fee-40e5-ba58-eee78200c885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:26.623413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac9fc-9fee-40e5-ba58-eee78200c885 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.623697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac9fc-9fee-40e5-ba58-eee78200c885 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.623987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac9fc-9fee-40e5-ba58-eee78200c885 None admin] PATH_INFO: `/v3/users/89763e88c29d432f9c32f06100d51f13` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.625764 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ac9fc-9fee-40e5-ba58-eee78200c885 None admin] RBAC: Authorizing `identity:get_user(user_id=89763e88c29d432f9c32f06100d51f13)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:26.627180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ac9fc-9fee-40e5-ba58-eee78200c885 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:26.628787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 572/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:26 2022] GET /identity/v3/users/89763e88c29d432f9c32f06100d51f13 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:26.634452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9a2bd-8ec8-4895-8b19-d4108b31c6df None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:26.728134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9a2bd-8ec8-4895-8b19-d4108b31c6df None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:26.759512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c582b44-44d7-4e1d-a127-e16d267c0d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:26.760372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c582b44-44d7-4e1d-a127-e16d267c0d6f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.760655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c582b44-44d7-4e1d-a127-e16d267c0d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.760929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c582b44-44d7-4e1d-a127-e16d267c0d6f None admin] PATH_INFO: `/v3/projects/db6f9f60396b411395c226853dbb4560` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.762088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c582b44-44d7-4e1d-a127-e16d267c0d6f None admin] RBAC: Authorizing `identity:get_project(project_id=db6f9f60396b411395c226853dbb4560)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:26.763488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c582b44-44d7-4e1d-a127-e16d267c0d6f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:26.765222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 580/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:26 2022] GET /identity/v3/projects/db6f9f60396b411395c226853dbb4560 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:26.770779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac9fc-9fee-40e5-ba58-eee78200c885 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:26.866440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac9fc-9fee-40e5-ba58-eee78200c885 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:26.887569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:26.899021 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0c938-ced1-463c-89e4-91b489c42557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:26.899902 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0c938-ced1-463c-89e4-91b489c42557 None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.900215 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0c938-ced1-463c-89e4-91b489c42557 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.900488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0c938-ced1-463c-89e4-91b489c42557 None admin] PATH_INFO: `/v3/projects/db6f9f60396b411395c226853dbb4560/users/89763e88c29d432f9c32f06100d51f13/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.902409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0c938-ced1-463c-89e4-91b489c42557 None admin] RBAC: Authorizing `identity:create_grant(project_id=db6f9f60396b411395c226853dbb4560, user_id=89763e88c29d432f9c32f06100d51f13, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:26.903820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0c938-ced1-463c-89e4-91b489c42557 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:26.916355 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 573/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:26 2022] PUT /identity/v3/projects/db6f9f60396b411395c226853dbb4560/users/89763e88c29d432f9c32f06100d51f13/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:28.962111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ba56b-7e20-456d-8b36-073683ddea5e None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:28.962673 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ba56b-7e20-456d-8b36-073683ddea5e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:28.962673 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ba56b-7e20-456d-8b36-073683ddea5e None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.964047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 581/1154] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:28.969942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d601f7c-0f34-4d77-b611-0ed4efcecc7a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:28.970324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d601f7c-0f34-4d77-b611-0ed4efcecc7a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:28.970495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d601f7c-0f34-4d77-b611-0ed4efcecc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.987760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0d601f7c-0f34-4d77-b611-0ed4efcecc7a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:28.988963 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0d601f7c-0f34-4d77-b611-0ed4efcecc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:29.054888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 574/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:29.077734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ba56b-7e20-456d-8b36-073683ddea5e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.133342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:29.176743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ba56b-7e20-456d-8b36-073683ddea5e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.208200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982a15-90e2-4d65-897e-d87ffc98f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.208982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982a15-90e2-4d65-897e-d87ffc98f53c None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.209268 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982a15-90e2-4d65-897e-d87ffc98f53c None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.209552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982a15-90e2-4d65-897e-d87ffc98f53c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.220782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c982a15-90e2-4d65-897e-d87ffc98f53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-8c982a15-90e2-4d65-897e-d87ffc98f53c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:29.228387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:29.229476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:13:29.230337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 582/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:29.235938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d601f7c-0f34-4d77-b611-0ed4efcecc7a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.330492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d601f7c-0f34-4d77-b611-0ed4efcecc7a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.343753 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:29.365098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cf4af-7f67-4caa-9184-cc662dc5d455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.365767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cf4af-7f67-4caa-9184-cc662dc5d455 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.366058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cf4af-7f67-4caa-9184-cc662dc5d455 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.366339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cf4af-7f67-4caa-9184-cc662dc5d455 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.367081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cf4af-7f67-4caa-9184-cc662dc5d455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:29.367392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cf4af-7f67-4caa-9184-cc662dc5d455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:29.368795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cf4af-7f67-4caa-9184-cc662dc5d455 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:29.376621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 575/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:29.382380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982a15-90e2-4d65-897e-d87ffc98f53c None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.476992 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982a15-90e2-4d65-897e-d87ffc98f53c None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.492238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:29.509208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89c901-32b6-408d-ac2c-8974dc42b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.510062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89c901-32b6-408d-ac2c-8974dc42b380 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.510344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89c901-32b6-408d-ac2c-8974dc42b380 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.510621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89c901-32b6-408d-ac2c-8974dc42b380 None admin] PATH_INFO: `/v3/users/89763e88c29d432f9c32f06100d51f13` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.511783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89c901-32b6-408d-ac2c-8974dc42b380 None admin] RBAC: Authorizing `identity:get_user(user_id=89763e88c29d432f9c32f06100d51f13)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:29.513244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89c901-32b6-408d-ac2c-8974dc42b380 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:29.515488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 583/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/users/89763e88c29d432f9c32f06100d51f13 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:29.520819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cf4af-7f67-4caa-9184-cc662dc5d455 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.621869 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cf4af-7f67-4caa-9184-cc662dc5d455 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.656015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54591dd-82e4-43fc-893c-bd9dfc5a5826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.656663 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54591dd-82e4-43fc-893c-bd9dfc5a5826 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.656951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54591dd-82e4-43fc-893c-bd9dfc5a5826 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.657231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54591dd-82e4-43fc-893c-bd9dfc5a5826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.701070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:29.726339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54591dd-82e4-43fc-893c-bd9dfc5a5826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:29.727826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54591dd-82e4-43fc-893c-bd9dfc5a5826 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:29.826937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 576/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:13:29.833474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89c901-32b6-408d-ac2c-8974dc42b380 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.927634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89c901-32b6-408d-ac2c-8974dc42b380 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.961105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779163c8-b808-40af-8676-2fb0f7e0db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.961957 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779163c8-b808-40af-8676-2fb0f7e0db4f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.962238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779163c8-b808-40af-8676-2fb0f7e0db4f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.962792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779163c8-b808-40af-8676-2fb0f7e0db4f None admin] PATH_INFO: `/v3/projects/db6f9f60396b411395c226853dbb4560` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.963653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779163c8-b808-40af-8676-2fb0f7e0db4f None admin] RBAC: Authorizing `identity:get_project(project_id=db6f9f60396b411395c226853dbb4560)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:29.965358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779163c8-b808-40af-8676-2fb0f7e0db4f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:29.967033 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 584/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/projects/db6f9f60396b411395c226853dbb4560 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:29.973127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54591dd-82e4-43fc-893c-bd9dfc5a5826 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:30.045659 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:30.070842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54591dd-82e4-43fc-893c-bd9dfc5a5826 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:30.103444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e3c89-05cf-4340-b3ee-bef96b048267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:30.104124 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e3c89-05cf-4340-b3ee-bef96b048267 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:30.104416 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e3c89-05cf-4340-b3ee-bef96b048267 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:30.104698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e3c89-05cf-4340-b3ee-bef96b048267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:30.105527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e3c89-05cf-4340-b3ee-bef96b048267 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=db6f9f60396b411395c226853dbb4560, user.id=89763e88c29d432f9c32f06100d51f13) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:30.105848 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e3c89-05cf-4340-b3ee-bef96b048267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:30.107273 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e3c89-05cf-4340-b3ee-bef96b048267 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:30.113580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 577/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/role_assignments?user.id=89763e88c29d432f9c32f06100d51f13&scope.project.id=db6f9f60396b411395c226853dbb4560&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:32.227562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908bee-19c1-452d-8505-56ebe75cf7dd None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:32.228248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908bee-19c1-452d-8505-56ebe75cf7dd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:32.228248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908bee-19c1-452d-8505-56ebe75cf7dd None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:32.229515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 585/1162] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:32.235321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40ca13-08e1-4909-acb0-7343e2025820 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:32.235736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40ca13-08e1-4909-acb0-7343e2025820 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:32.235885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40ca13-08e1-4909-acb0-7343e2025820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:32.252280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-bc40ca13-08e1-4909-acb0-7343e2025820 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:32.253459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-bc40ca13-08e1-4909-acb0-7343e2025820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:32.318581 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 578/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:32.340849 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf908bee-19c1-452d-8505-56ebe75cf7dd None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:32.392336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:32.437185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf908bee-19c1-452d-8505-56ebe75cf7dd None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:32.469354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196944ad-b5f4-4c16-83e6-5d3ecc82c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:32.469980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196944ad-b5f4-4c16-83e6-5d3ecc82c308 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:32.470263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196944ad-b5f4-4c16-83e6-5d3ecc82c308 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:32.470539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196944ad-b5f4-4c16-83e6-5d3ecc82c308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:32.534595 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196944ad-b5f4-4c16-83e6-5d3ecc82c308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:32.536027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196944ad-b5f4-4c16-83e6-5d3ecc82c308 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:32.583726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:32.629181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 586/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:13:32.634905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40ca13-08e1-4909-acb0-7343e2025820 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:32.698113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:32.730213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40ca13-08e1-4909-acb0-7343e2025820 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:32.762808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92222a-da9d-4422-b66c-4d3f6e8b9bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:32.763596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92222a-da9d-4422-b66c-4d3f6e8b9bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:32.763885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92222a-da9d-4422-b66c-4d3f6e8b9bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:32.764194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92222a-da9d-4422-b66c-4d3f6e8b9bb2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:32.770703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92222a-da9d-4422-b66c-4d3f6e8b9bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:32.772188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92222a-da9d-4422-b66c-4d3f6e8b9bb2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-2e92222a-da9d-4422-b66c-4d3f6e8b9bb2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:32.786712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:32.788055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:13:32.789161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 579/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 16 00:13:32 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:32.793666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196944ad-b5f4-4c16-83e6-5d3ecc82c308 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:32.889336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196944ad-b5f4-4c16-83e6-5d3ecc82c308 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:32.922819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8394c88-6030-43c1-93a4-9fa63dc841d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:32.923467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8394c88-6030-43c1-93a4-9fa63dc841d8 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:32.923753 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8394c88-6030-43c1-93a4-9fa63dc841d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:32.924059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8394c88-6030-43c1-93a4-9fa63dc841d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:32.924778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8394c88-6030-43c1-93a4-9fa63dc841d8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:32.925089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8394c88-6030-43c1-93a4-9fa63dc841d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:32.926444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8394c88-6030-43c1-93a4-9fa63dc841d8 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:32.938101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 587/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 16 00:13:32 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:35.001862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0226e5-14e9-452a-b76a-9085aa64b16e None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:35.002461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0226e5-14e9-452a-b76a-9085aa64b16e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:35.002461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0226e5-14e9-452a-b76a-9085aa64b16e None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:35.003800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 580/1167] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:35.009112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626b455-c082-42b5-9b70-0f90d8b0e9f3 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:35.009603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626b455-c082-42b5-9b70-0f90d8b0e9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:35.009704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626b455-c082-42b5-9b70-0f90d8b0e9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:35.026871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-9626b455-c082-42b5-9b70-0f90d8b0e9f3 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:35.028104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9626b455-c082-42b5-9b70-0f90d8b0e9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:35.039180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:35.093432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 588/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:35.116080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0226e5-14e9-452a-b76a-9085aa64b16e None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:35.215071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0226e5-14e9-452a-b76a-9085aa64b16e None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:35.240595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:35.250815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24298e5-686c-45aa-add7-53e91b657091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:35.251463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24298e5-686c-45aa-add7-53e91b657091 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:35.251744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24298e5-686c-45aa-add7-53e91b657091 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:35.252100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24298e5-686c-45aa-add7-53e91b657091 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:35.252799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24298e5-686c-45aa-add7-53e91b657091 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:35.254147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24298e5-686c-45aa-add7-53e91b657091 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:35.267402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 581/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Thu Jun 16 00:13:35 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:37.385624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87575-c350-45b3-ad42-cc53ed3dd133 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.386171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87575-c350-45b3-ad42-cc53ed3dd133 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.386171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff87575-c350-45b3-ad42-cc53ed3dd133 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.387568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 589/1170] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:37.393219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2f111-a353-496c-bb0d-1bd3f1749778 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.393601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2f111-a353-496c-bb0d-1bd3f1749778 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.393789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2f111-a353-496c-bb0d-1bd3f1749778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.410017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2fe2f111-a353-496c-bb0d-1bd3f1749778 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:37.411194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2fe2f111-a353-496c-bb0d-1bd3f1749778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:37.475063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 582/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:37.498340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff87575-c350-45b3-ad42-cc53ed3dd133 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:37.597374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff87575-c350-45b3-ad42-cc53ed3dd133 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:37.628921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38295a7-fe3e-41af-ab5d-6e19e3beebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:37.629761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38295a7-fe3e-41af-ab5d-6e19e3beebd2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.630041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38295a7-fe3e-41af-ab5d-6e19e3beebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.630316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38295a7-fe3e-41af-ab5d-6e19e3beebd2 None admin] PATH_INFO: `/v3/domains/a819f2c934f8430d94cc69d45972660e` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.640780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38295a7-fe3e-41af-ab5d-6e19e3beebd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a819f2c934f8430d94cc69d45972660e)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:37.642141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38295a7-fe3e-41af-ab5d-6e19e3beebd2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:37.643725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 590/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Jun 16 00:13:37 2022] GET /identity/v3/domains/a819f2c934f8430d94cc69d45972660e => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:37.649405 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2f111-a353-496c-bb0d-1bd3f1749778 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:37.745183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2f111-a353-496c-bb0d-1bd3f1749778 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:37.762308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:37.781165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b106617-3389-4586-95e5-149a4c64c25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:37.781819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106617-3389-4586-95e5-149a4c64c25d None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.782108 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106617-3389-4586-95e5-149a4c64c25d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.782389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b106617-3389-4586-95e5-149a4c64c25d None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.783120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b106617-3389-4586-95e5-149a4c64c25d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:37.784602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b106617-3389-4586-95e5-149a4c64c25d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:37.807664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 583/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:13:37 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:39.923157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2ecb-56c0-4c04-874c-3a264eb18ec6 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.923717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2ecb-56c0-4c04-874c-3a264eb18ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.923717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2ecb-56c0-4c04-874c-3a264eb18ec6 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.925113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 591/1174] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:39.930393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8921b-a3d9-42ed-8eae-0f8e7f2bb6c0 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.930837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8921b-a3d9-42ed-8eae-0f8e7f2bb6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.930937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8921b-a3d9-42ed-8eae-0f8e7f2bb6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.947233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-11f8921b-a3d9-42ed-8eae-0f8e7f2bb6c0 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:39.948441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-11f8921b-a3d9-42ed-8eae-0f8e7f2bb6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:40.012546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 584/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:40.037798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd2ecb-56c0-4c04-874c-3a264eb18ec6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.047412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.137287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd2ecb-56c0-4c04-874c-3a264eb18ec6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.169023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7a62b-be92-45f9-a08d-3c93c95bae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.169881 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7a62b-be92-45f9-a08d-3c93c95bae56 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.170169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7a62b-be92-45f9-a08d-3c93c95bae56 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.170452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7a62b-be92-45f9-a08d-3c93c95bae56 None admin] PATH_INFO: `/v3/domains/a819f2c934f8430d94cc69d45972660e` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.172255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7a62b-be92-45f9-a08d-3c93c95bae56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a819f2c934f8430d94cc69d45972660e)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.173732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7a62b-be92-45f9-a08d-3c93c95bae56 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.175281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 592/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/domains/a819f2c934f8430d94cc69d45972660e => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:40.180962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8921b-a3d9-42ed-8eae-0f8e7f2bb6c0 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.272204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.275240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8921b-a3d9-42ed-8eae-0f8e7f2bb6c0 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.309574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d510fca-5e41-44a2-8e83-34bf1a81a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.310227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510fca-5e41-44a2-8e83-34bf1a81a501 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.310509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510fca-5e41-44a2-8e83-34bf1a81a501 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.310784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d510fca-5e41-44a2-8e83-34bf1a81a501 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.311492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d510fca-5e41-44a2-8e83-34bf1a81a501 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.312935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d510fca-5e41-44a2-8e83-34bf1a81a501 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.331227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 585/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:40 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:13:42.453590 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee915fe-2533-40ab-a0fe-37ceb14f0c4a None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:42.454138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee915fe-2533-40ab-a0fe-37ceb14f0c4a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:42.454138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee915fe-2533-40ab-a0fe-37ceb14f0c4a None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:42.455494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 593/1178] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:42.460549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabb4c8-fa17-433e-b8d7-c5f0ae4dd07c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:42.460984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabb4c8-fa17-433e-b8d7-c5f0ae4dd07c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:42.461118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabb4c8-fa17-433e-b8d7-c5f0ae4dd07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:42.478144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ecabb4c8-fa17-433e-b8d7-c5f0ae4dd07c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:42.479321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ecabb4c8-fa17-433e-b8d7-c5f0ae4dd07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:42.542829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 586/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:42.565582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee915fe-2533-40ab-a0fe-37ceb14f0c4a None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:42.639181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:42.664274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee915fe-2533-40ab-a0fe-37ceb14f0c4a None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:42.696056 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb5be5-e85a-4b01-a029-9d4259fb812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:42.696820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5be5-e85a-4b01-a029-9d4259fb812f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:42.697102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5be5-e85a-4b01-a029-9d4259fb812f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:42.697376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb5be5-e85a-4b01-a029-9d4259fb812f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:42.708172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb5be5-e85a-4b01-a029-9d4259fb812f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-7afb5be5-e85a-4b01-a029-9d4259fb812f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:42.716030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:42.717174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:13:42.718252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 594/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:42.722963 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabb4c8-fa17-433e-b8d7-c5f0ae4dd07c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:42.804454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:42.820782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabb4c8-fa17-433e-b8d7-c5f0ae4dd07c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:42.853173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb11941-088b-4177-858b-8b4c88a958c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:42.853826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb11941-088b-4177-858b-8b4c88a958c0 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:42.854136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb11941-088b-4177-858b-8b4c88a958c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:42.854414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb11941-088b-4177-858b-8b4c88a958c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:42.855153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb11941-088b-4177-858b-8b4c88a958c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:42.855463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb11941-088b-4177-858b-8b4c88a958c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:42.856851 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb11941-088b-4177-858b-8b4c88a958c0 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:42.865136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 587/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:42.870768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb5be5-e85a-4b01-a029-9d4259fb812f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:42.967477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb5be5-e85a-4b01-a029-9d4259fb812f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:43.001344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff8614-0605-48de-bcbe-2e51e62ce5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:43.002212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff8614-0605-48de-bcbe-2e51e62ce5ce None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.002499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff8614-0605-48de-bcbe-2e51e62ce5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.002778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff8614-0605-48de-bcbe-2e51e62ce5ce None admin] PATH_INFO: `/v3/users/d47f711a29e04b5e978fbe950d744dc0` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.004695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:43.016904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff8614-0605-48de-bcbe-2e51e62ce5ce None admin] RBAC: Authorizing `identity:get_user(user_id=d47f711a29e04b5e978fbe950d744dc0)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:43.018359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff8614-0605-48de-bcbe-2e51e62ce5ce None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:43.020068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 595/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:42 2022] GET /identity/v3/users/d47f711a29e04b5e978fbe950d744dc0 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:43.025635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb11941-088b-4177-858b-8b4c88a958c0 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:43.120822 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb11941-088b-4177-858b-8b4c88a958c0 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:43.152469 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748d663-00c9-4240-831c-9ecd9e77f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:43.153098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748d663-00c9-4240-831c-9ecd9e77f844 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.153380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748d663-00c9-4240-831c-9ecd9e77f844 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.153655 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748d663-00c9-4240-831c-9ecd9e77f844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.170605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:43.218779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748d663-00c9-4240-831c-9ecd9e77f844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:43.220165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748d663-00c9-4240-831c-9ecd9e77f844 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:43.312640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 588/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:13:43.318325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff8614-0605-48de-bcbe-2e51e62ce5ce None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:43.414643 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff8614-0605-48de-bcbe-2e51e62ce5ce None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:43.447090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5733f-c182-4d6e-9724-5e90905e823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:43.447940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5733f-c182-4d6e-9724-5e90905e823b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.448261 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5733f-c182-4d6e-9724-5e90905e823b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.448542 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5733f-c182-4d6e-9724-5e90905e823b None admin] PATH_INFO: `/v3/projects/51b6945b1d5c4dba9d0e0ccf32ab34b5` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.449719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5733f-c182-4d6e-9724-5e90905e823b None admin] RBAC: Authorizing `identity:get_project(project_id=51b6945b1d5c4dba9d0e0ccf32ab34b5)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:43.451139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5733f-c182-4d6e-9724-5e90905e823b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:43.452922 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 596/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:43 2022] GET /identity/v3/projects/51b6945b1d5c4dba9d0e0ccf32ab34b5 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:43.459002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748d663-00c9-4240-831c-9ecd9e77f844 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:43.505571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:43.554365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748d663-00c9-4240-831c-9ecd9e77f844 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:43.588135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d0960-a547-4a8d-9683-7ecdff50ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:43.588779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d0960-a547-4a8d-9683-7ecdff50ac63 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.589061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d0960-a547-4a8d-9683-7ecdff50ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.589599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d0960-a547-4a8d-9683-7ecdff50ac63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.590416 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d0960-a547-4a8d-9683-7ecdff50ac63 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=51b6945b1d5c4dba9d0e0ccf32ab34b5, user.id=d47f711a29e04b5e978fbe950d744dc0) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:43.590728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d0960-a547-4a8d-9683-7ecdff50ac63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:43.592151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d0960-a547-4a8d-9683-7ecdff50ac63 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:43.598129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 589/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:43 2022] GET /identity/v3/role_assignments?user.id=d47f711a29e04b5e978fbe950d744dc0&scope.project.id=51b6945b1d5c4dba9d0e0ccf32ab34b5&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:45.687024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1e954-322c-4682-a5a1-fbda88a184c8 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.687584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1e954-322c-4682-a5a1-fbda88a184c8 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.687584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1e954-322c-4682-a5a1-fbda88a184c8 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.688969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 597/1186] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:45.694062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b91e99-6fed-411c-a2fc-cbcb969bd389 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.694495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b91e99-6fed-411c-a2fc-cbcb969bd389 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.694607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b91e99-6fed-411c-a2fc-cbcb969bd389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.711454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-f4b91e99-6fed-411c-a2fc-cbcb969bd389 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:45.712664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f4b91e99-6fed-411c-a2fc-cbcb969bd389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:45.775748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 590/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:45.798081 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1e954-322c-4682-a5a1-fbda88a184c8 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.855780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.896210 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1e954-322c-4682-a5a1-fbda88a184c8 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.928320 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b7e5-e3ba-4ad0-b0b7-a3b3ae329889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.929094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b7e5-e3ba-4ad0-b0b7-a3b3ae329889 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.929375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b7e5-e3ba-4ad0-b0b7-a3b3ae329889 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.929649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b7e5-e3ba-4ad0-b0b7-a3b3ae329889 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.939896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8b7e5-e3ba-4ad0-b0b7-a3b3ae329889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-9ea8b7e5-e3ba-4ad0-b0b7-a3b3ae329889 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:45.947420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:45.948514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:13:45.949543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 598/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:45.954689 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b91e99-6fed-411c-a2fc-cbcb969bd389 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.995910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:46.051702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b91e99-6fed-411c-a2fc-cbcb969bd389 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.084367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172e4d0-79d1-4e92-9d2c-bbb3903b76d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.085026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e4d0-79d1-4e92-9d2c-bbb3903b76d0 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.085309 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e4d0-79d1-4e92-9d2c-bbb3903b76d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.085584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172e4d0-79d1-4e92-9d2c-bbb3903b76d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.086317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172e4d0-79d1-4e92-9d2c-bbb3903b76d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:46.086622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172e4d0-79d1-4e92-9d2c-bbb3903b76d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.087986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172e4d0-79d1-4e92-9d2c-bbb3903b76d0 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.095929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 591/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:46.101556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b7e5-e3ba-4ad0-b0b7-a3b3ae329889 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.197622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b7e5-e3ba-4ad0-b0b7-a3b3ae329889 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.216245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:46.230722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb0ba1-ce37-4b32-8014-de5a89be70d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.231589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb0ba1-ce37-4b32-8014-de5a89be70d6 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.231875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb0ba1-ce37-4b32-8014-de5a89be70d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.232187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb0ba1-ce37-4b32-8014-de5a89be70d6 None admin] PATH_INFO: `/v3/users/d47f711a29e04b5e978fbe950d744dc0` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.233954 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb0ba1-ce37-4b32-8014-de5a89be70d6 None admin] RBAC: Authorizing `identity:get_user(user_id=d47f711a29e04b5e978fbe950d744dc0)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.235387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb0ba1-ce37-4b32-8014-de5a89be70d6 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.237039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 599/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/users/d47f711a29e04b5e978fbe950d744dc0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:46.242798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172e4d0-79d1-4e92-9d2c-bbb3903b76d0 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.336741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172e4d0-79d1-4e92-9d2c-bbb3903b76d0 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.338928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:46.369560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba0789-2cba-4c7d-ac0d-27bd66c4a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.370400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba0789-2cba-4c7d-ac0d-27bd66c4a6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.370682 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba0789-2cba-4c7d-ac0d-27bd66c4a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.370957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba0789-2cba-4c7d-ac0d-27bd66c4a6e2 None admin] PATH_INFO: `/v3/projects/51b6945b1d5c4dba9d0e0ccf32ab34b5` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.372140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba0789-2cba-4c7d-ac0d-27bd66c4a6e2 None admin] RBAC: Authorizing `identity:get_project(project_id=51b6945b1d5c4dba9d0e0ccf32ab34b5)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.374071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba0789-2cba-4c7d-ac0d-27bd66c4a6e2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.375717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 592/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/projects/51b6945b1d5c4dba9d0e0ccf32ab34b5 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:46.381571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb0ba1-ce37-4b32-8014-de5a89be70d6 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.479147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb0ba1-ce37-4b32-8014-de5a89be70d6 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.511156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d245195-27d5-4d40-bfee-98d9d026a894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.512048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d245195-27d5-4d40-bfee-98d9d026a894 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.512339 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d245195-27d5-4d40-bfee-98d9d026a894 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.512618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d245195-27d5-4d40-bfee-98d9d026a894 None admin] PATH_INFO: `/v3/projects/51b6945b1d5c4dba9d0e0ccf32ab34b5/users/d47f711a29e04b5e978fbe950d744dc0/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.515075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d245195-27d5-4d40-bfee-98d9d026a894 None admin] RBAC: Authorizing `identity:create_grant(project_id=51b6945b1d5c4dba9d0e0ccf32ab34b5, user_id=d47f711a29e04b5e978fbe950d744dc0, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.516532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d245195-27d5-4d40-bfee-98d9d026a894 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.528783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 600/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:46 2022] PUT /identity/v3/projects/51b6945b1d5c4dba9d0e0ccf32ab34b5/users/d47f711a29e04b5e978fbe950d744dc0/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:48.582178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9633939-f9cb-4c66-b0a2-de9952ef997b None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.582705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9633939-f9cb-4c66-b0a2-de9952ef997b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.582796 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9633939-f9cb-4c66-b0a2-de9952ef997b None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.584125 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 593/1193] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:48.589135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9a73-4378-4048-8db1-9d9efa80be68 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.589774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9a73-4378-4048-8db1-9d9efa80be68 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.589939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9a73-4378-4048-8db1-9d9efa80be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.606087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a6cd9a73-4378-4048-8db1-9d9efa80be68 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:48.607257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a6cd9a73-4378-4048-8db1-9d9efa80be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:48.656695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.680330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 601/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:13:48.704417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9633939-f9cb-4c66-b0a2-de9952ef997b None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.803324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9633939-f9cb-4c66-b0a2-de9952ef997b None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.836334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a54e95-90c3-46ba-a8ec-87da2fe8705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.837056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a54e95-90c3-46ba-a8ec-87da2fe8705e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.837345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a54e95-90c3-46ba-a8ec-87da2fe8705e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.837629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a54e95-90c3-46ba-a8ec-87da2fe8705e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.847831 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a54e95-90c3-46ba-a8ec-87da2fe8705e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-35a54e95-90c3-46ba-a8ec-87da2fe8705e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:48.855566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:48.856686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:13:48.858183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 594/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:48.863135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd9a73-4378-4048-8db1-9d9efa80be68 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.957765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd9a73-4378-4048-8db1-9d9efa80be68 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.990315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971c238-33dc-4b9a-a3eb-9842d846fa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.990967 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c238-33dc-4b9a-a3eb-9842d846fa87 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.991257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c238-33dc-4b9a-a3eb-9842d846fa87 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.991535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c238-33dc-4b9a-a3eb-9842d846fa87 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.992301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971c238-33dc-4b9a-a3eb-9842d846fa87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:48.992612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971c238-33dc-4b9a-a3eb-9842d846fa87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.993962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971c238-33dc-4b9a-a3eb-9842d846fa87 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:49.001677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 602/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:49.007503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a54e95-90c3-46ba-a8ec-87da2fe8705e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:49.038922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:49.105298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a54e95-90c3-46ba-a8ec-87da2fe8705e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:49.137255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aefc05-a826-4b11-9eba-0c2816f778c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:49.138119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aefc05-a826-4b11-9eba-0c2816f778c3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:49.138405 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aefc05-a826-4b11-9eba-0c2816f778c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:49.138683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aefc05-a826-4b11-9eba-0c2816f778c3 None admin] PATH_INFO: `/v3/users/d47f711a29e04b5e978fbe950d744dc0` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:49.140476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aefc05-a826-4b11-9eba-0c2816f778c3 None admin] RBAC: Authorizing `identity:get_user(user_id=d47f711a29e04b5e978fbe950d744dc0)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:49.141899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aefc05-a826-4b11-9eba-0c2816f778c3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:49.143501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 595/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:49 2022] GET /identity/v3/users/d47f711a29e04b5e978fbe950d744dc0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:49.149411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971c238-33dc-4b9a-a3eb-9842d846fa87 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:49.189767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:49.245487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971c238-33dc-4b9a-a3eb-9842d846fa87 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:49.277839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d6d0-30c0-46aa-ae1a-4238c8aa7225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:49.278472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d6d0-30c0-46aa-ae1a-4238c8aa7225 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:49.278758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d6d0-30c0-46aa-ae1a-4238c8aa7225 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:49.279037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d6d0-30c0-46aa-ae1a-4238c8aa7225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:49.342684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970d6d0-30c0-46aa-ae1a-4238c8aa7225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:49.344136 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970d6d0-30c0-46aa-ae1a-4238c8aa7225 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:49.381883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:49.437932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 603/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:13:49.443626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aefc05-a826-4b11-9eba-0c2816f778c3 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:49.537544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:49.540230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aefc05-a826-4b11-9eba-0c2816f778c3 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:49.572850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba324e-e07f-485b-a9bf-302a02766947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:49.573723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba324e-e07f-485b-a9bf-302a02766947 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:49.574007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba324e-e07f-485b-a9bf-302a02766947 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:49.574285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba324e-e07f-485b-a9bf-302a02766947 None admin] PATH_INFO: `/v3/projects/51b6945b1d5c4dba9d0e0ccf32ab34b5` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:49.575453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba324e-e07f-485b-a9bf-302a02766947 None admin] RBAC: Authorizing `identity:get_project(project_id=51b6945b1d5c4dba9d0e0ccf32ab34b5)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:49.577415 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba324e-e07f-485b-a9bf-302a02766947 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:49.579076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 596/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:49 2022] GET /identity/v3/projects/51b6945b1d5c4dba9d0e0ccf32ab34b5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:49.585028 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d6d0-30c0-46aa-ae1a-4238c8aa7225 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:49.679747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d6d0-30c0-46aa-ae1a-4238c8aa7225 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:49.712379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0312dd6-ab5c-405e-94d0-2365333e77d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:49.713033 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312dd6-ab5c-405e-94d0-2365333e77d7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:49.713319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312dd6-ab5c-405e-94d0-2365333e77d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:49.713596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312dd6-ab5c-405e-94d0-2365333e77d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:49.714665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0312dd6-ab5c-405e-94d0-2365333e77d7 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=51b6945b1d5c4dba9d0e0ccf32ab34b5, user.id=d47f711a29e04b5e978fbe950d744dc0) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:49.714978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0312dd6-ab5c-405e-94d0-2365333e77d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:49.716429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0312dd6-ab5c-405e-94d0-2365333e77d7 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:49.722739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 604/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:49 2022] GET /identity/v3/role_assignments?user.id=d47f711a29e04b5e978fbe950d744dc0&scope.project.id=51b6945b1d5c4dba9d0e0ccf32ab34b5&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:59.568810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=16 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:59.720158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:45.262241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c8f3-71bd-496d-9029-3fa88d53f19f None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.262844 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c8f3-71bd-496d-9029-3fa88d53f19f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.262844 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c8f3-71bd-496d-9029-3fa88d53f19f None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.265840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 597/1201] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:45.269830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284cfe6-235f-4f23-92e5-cb1b14502e45 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.270347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284cfe6-235f-4f23-92e5-cb1b14502e45 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.270652 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284cfe6-235f-4f23-92e5-cb1b14502e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.290407 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-5284cfe6-235f-4f23-92e5-cb1b14502e45 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:45.291649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5284cfe6-235f-4f23-92e5-cb1b14502e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:45.386374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 605/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:45.417368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0c8f3-71bd-496d-9029-3fa88d53f19f None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.549848 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0c8f3-71bd-496d-9029-3fa88d53f19f None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.589096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2497d-7a6e-4dd4-a3f8-964d0d604ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.590377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2497d-7a6e-4dd4-a3f8-964d0d604ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.590662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2497d-7a6e-4dd4-a3f8-964d0d604ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.590952 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2497d-7a6e-4dd4-a3f8-964d0d604ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.604841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2497d-7a6e-4dd4-a3f8-964d0d604ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.610079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2497d-7a6e-4dd4-a3f8-964d0d604ad3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-f8c2497d-7a6e-4dd4-a3f8-964d0d604ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:45.635710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:45.637008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:45.638358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:45.638358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:45.638358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:45.638358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:14:45.638358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 598/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:45.649070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284cfe6-235f-4f23-92e5-cb1b14502e45 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.791585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284cfe6-235f-4f23-92e5-cb1b14502e45 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.832702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:45.841026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87cf64-6b4b-462f-83da-7d8a8665e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.841753 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87cf64-6b4b-462f-83da-7d8a8665e290 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.842115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87cf64-6b4b-462f-83da-7d8a8665e290 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.842420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87cf64-6b4b-462f-83da-7d8a8665e290 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.843313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87cf64-6b4b-462f-83da-7d8a8665e290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:45.843701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87cf64-6b4b-462f-83da-7d8a8665e290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.845399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87cf64-6b4b-462f-83da-7d8a8665e290 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.863796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 606/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:45.870102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2497d-7a6e-4dd4-a3f8-964d0d604ad3 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.950286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:46.015595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2497d-7a6e-4dd4-a3f8-964d0d604ad3 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:46.068044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcb9b0-6fd3-435c-bb0a-cc40bfcc4e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:46.068874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb9b0-6fd3-435c-bb0a-cc40bfcc4e04 None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:46.069218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb9b0-6fd3-435c-bb0a-cc40bfcc4e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:46.069462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb9b0-6fd3-435c-bb0a-cc40bfcc4e04 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:46.070273 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcb9b0-6fd3-435c-bb0a-cc40bfcc4e04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:46.071833 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcb9b0-6fd3-435c-bb0a-cc40bfcc4e04 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:46.098462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 599/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:45 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:48.464297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59033dce-2340-4248-9030-25f851cd51d3 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.464912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59033dce-2340-4248-9030-25f851cd51d3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.464912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59033dce-2340-4248-9030-25f851cd51d3 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.466219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 607/1206] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:48.471665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36313ff-5131-45e2-b0b1-565176d2765d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.472156 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36313ff-5131-45e2-b0b1-565176d2765d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.472295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36313ff-5131-45e2-b0b1-565176d2765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.491155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e36313ff-5131-45e2-b0b1-565176d2765d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:48.492581 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e36313ff-5131-45e2-b0b1-565176d2765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:48.584012 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 600/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:48.603682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59033dce-2340-4248-9030-25f851cd51d3 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.728311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59033dce-2340-4248-9030-25f851cd51d3 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.769162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8b940-e635-4d73-8017-40c398728b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.770038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8b940-e635-4d73-8017-40c398728b51 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.770329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8b940-e635-4d73-8017-40c398728b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.770642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8b940-e635-4d73-8017-40c398728b51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.783162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8b940-e635-4d73-8017-40c398728b51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-90c8b940-e635-4d73-8017-40c398728b51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:48.790851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:48.791874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:14:48.793308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 608/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:48.798613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36313ff-5131-45e2-b0b1-565176d2765d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.849383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.923195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36313ff-5131-45e2-b0b1-565176d2765d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.960650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec148dc-5a8a-406d-bf45-f87d865b9db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.962024 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec148dc-5a8a-406d-bf45-f87d865b9db5 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.962024 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec148dc-5a8a-406d-bf45-f87d865b9db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.962218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec148dc-5a8a-406d-bf45-f87d865b9db5 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.962854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec148dc-5a8a-406d-bf45-f87d865b9db5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:48.963484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec148dc-5a8a-406d-bf45-f87d865b9db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.965536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec148dc-5a8a-406d-bf45-f87d865b9db5 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.980245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 601/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:48.981758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8b940-e635-4d73-8017-40c398728b51 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.048717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:49.110628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8b940-e635-4d73-8017-40c398728b51 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.153100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87508697-fbab-4fe2-ba62-98d457d2e589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.153960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87508697-fbab-4fe2-ba62-98d457d2e589 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.154253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87508697-fbab-4fe2-ba62-98d457d2e589 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.154534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87508697-fbab-4fe2-ba62-98d457d2e589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.166607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87508697-fbab-4fe2-ba62-98d457d2e589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.168766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87508697-fbab-4fe2-ba62-98d457d2e589 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-87508697-fbab-4fe2-ba62-98d457d2e589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:49.190181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:49.191376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:49.192557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:49.192557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:49.192557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:49.192557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:14:49.192557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 609/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:49.196532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec148dc-5a8a-406d-bf45-f87d865b9db5 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.317870 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:49.321062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec148dc-5a8a-406d-bf45-f87d865b9db5 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.364527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f40813-458d-49b4-a85b-8fc7192bc234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.365223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40813-458d-49b4-a85b-8fc7192bc234 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.365549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40813-458d-49b4-a85b-8fc7192bc234 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.365874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f40813-458d-49b4-a85b-8fc7192bc234 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.366624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f40813-458d-49b4-a85b-8fc7192bc234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:49.366945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f40813-458d-49b4-a85b-8fc7192bc234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.368344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f40813-458d-49b4-a85b-8fc7192bc234 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.381384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 602/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:49.387283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87508697-fbab-4fe2-ba62-98d457d2e589 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.510844 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87508697-fbab-4fe2-ba62-98d457d2e589 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.513026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:49.549139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def76a6c-1614-434a-9526-04c5968e848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.551316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def76a6c-1614-434a-9526-04c5968e848b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.551582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def76a6c-1614-434a-9526-04c5968e848b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.551871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def76a6c-1614-434a-9526-04c5968e848b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.559561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def76a6c-1614-434a-9526-04c5968e848b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.561054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def76a6c-1614-434a-9526-04c5968e848b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-def76a6c-1614-434a-9526-04c5968e848b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:49.577593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:49.578782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:49.580049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:49.580049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:49.580049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:49.580049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:49.580049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:49.580049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:49.580049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:49.580049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:49.580049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:14:49.580049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:14:49.584605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f40813-458d-49b4-a85b-8fc7192bc234 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.585103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 610/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:49.705090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f40813-458d-49b4-a85b-8fc7192bc234 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.742411 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d3774-1e8a-4c8f-a2ed-a52c79729fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.743125 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d3774-1e8a-4c8f-a2ed-a52c79729fdc None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.743410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d3774-1e8a-4c8f-a2ed-a52c79729fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.743688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d3774-1e8a-4c8f-a2ed-a52c79729fdc None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.744621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d3774-1e8a-4c8f-a2ed-a52c79729fdc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:49.745061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d3774-1e8a-4c8f-a2ed-a52c79729fdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.746616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d3774-1e8a-4c8f-a2ed-a52c79729fdc None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.765671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 603/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:49.771350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def76a6c-1614-434a-9526-04c5968e848b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.888521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def76a6c-1614-434a-9526-04c5968e848b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.929935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df78d2-bb15-4998-b331-cd48e0d12923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.930586 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df78d2-bb15-4998-b331-cd48e0d12923 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.930874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df78d2-bb15-4998-b331-cd48e0d12923 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.931154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df78d2-bb15-4998-b331-cd48e0d12923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.963542 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:50.013149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df78d2-bb15-4998-b331-cd48e0d12923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:50.014611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df78d2-bb15-4998-b331-cd48e0d12923 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:50.137015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 611/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:14:50.138983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d3774-1e8a-4c8f-a2ed-a52c79729fdc None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:50.163013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:50.263400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d3774-1e8a-4c8f-a2ed-a52c79729fdc None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:50.301689 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaff3de-af06-459a-9c54-c0ce163deca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:50.302747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaff3de-af06-459a-9c54-c0ce163deca1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.303038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaff3de-af06-459a-9c54-c0ce163deca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.303326 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaff3de-af06-459a-9c54-c0ce163deca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.320022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaff3de-af06-459a-9c54-c0ce163deca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:50.321809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaff3de-af06-459a-9c54-c0ce163deca1 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-edaff3de-af06-459a-9c54-c0ce163deca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:50.343722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:50.344827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:50.345761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:50.345761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:50.345761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:50.345761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:14:50.351998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 604/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:50.352150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df78d2-bb15-4998-b331-cd48e0d12923 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:50.427027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:50.485214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df78d2-bb15-4998-b331-cd48e0d12923 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:50.525227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038944d0-c0dc-4686-91a5-65b6b4f6eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:50.525920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038944d0-c0dc-4686-91a5-65b6b4f6eb86 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.526248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038944d0-c0dc-4686-91a5-65b6b4f6eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.526514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038944d0-c0dc-4686-91a5-65b6b4f6eb86 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.527375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038944d0-c0dc-4686-91a5-65b6b4f6eb86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:50.527696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038944d0-c0dc-4686-91a5-65b6b4f6eb86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:50.529317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038944d0-c0dc-4686-91a5-65b6b4f6eb86 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:50.543084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 612/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:50.549115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaff3de-af06-459a-9c54-c0ce163deca1 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:50.632180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:50.672192 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaff3de-af06-459a-9c54-c0ce163deca1 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:50.710505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a10845-c117-49a1-ae77-04936cd8d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:50.711271 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10845-c117-49a1-ae77-04936cd8d01f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.711574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10845-c117-49a1-ae77-04936cd8d01f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.711864 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10845-c117-49a1-ae77-04936cd8d01f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.721276 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a10845-c117-49a1-ae77-04936cd8d01f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:50.722725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a10845-c117-49a1-ae77-04936cd8d01f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-71a10845-c117-49a1-ae77-04936cd8d01f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:50.740221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:50.741243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:50.742147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:50.742147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:50.742147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:50.742147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:50.742147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:50.742147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:50.742147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:50.742147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:14:50.742147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 605/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:50.747941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038944d0-c0dc-4686-91a5-65b6b4f6eb86 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:50.873144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038944d0-c0dc-4686-91a5-65b6b4f6eb86 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:50.898824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:50.914310 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f142ece-dfb5-46a2-a907-00c6e53324ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:50.915264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142ece-dfb5-46a2-a907-00c6e53324ba None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.915550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142ece-dfb5-46a2-a907-00c6e53324ba None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.915865 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f142ece-dfb5-46a2-a907-00c6e53324ba None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.917237 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f142ece-dfb5-46a2-a907-00c6e53324ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:50.917237 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f142ece-dfb5-46a2-a907-00c6e53324ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:50.918517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f142ece-dfb5-46a2-a907-00c6e53324ba None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:50.934901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 613/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:50.941531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a10845-c117-49a1-ae77-04936cd8d01f None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:51.061792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a10845-c117-49a1-ae77-04936cd8d01f None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:51.094878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:51.102238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527adfbf-05e7-4cda-8b4f-336cd9e39dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:51.103038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527adfbf-05e7-4cda-8b4f-336cd9e39dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.103342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527adfbf-05e7-4cda-8b4f-336cd9e39dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.103688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527adfbf-05e7-4cda-8b4f-336cd9e39dd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.104699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527adfbf-05e7-4cda-8b4f-336cd9e39dd3 None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=7dde39c6d85446a681dea24573f0d6e2) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:51.105621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527adfbf-05e7-4cda-8b4f-336cd9e39dd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:51.107113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527adfbf-05e7-4cda-8b4f-336cd9e39dd3 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:51.116037 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 606/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:50 2022] GET /identity/v3/role_assignments?user.id=7dde39c6d85446a681dea24573f0d6e2&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:53.382391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3e588-6165-47aa-b382-5c5c3d6df7c4 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.382937 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3e588-6165-47aa-b382-5c5c3d6df7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.383027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3e588-6165-47aa-b382-5c5c3d6df7c4 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.384394 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 614/1220] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:53.389497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d77972-2df9-42fe-871d-25f40d9c9033 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.389939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d77972-2df9-42fe-871d-25f40d9c9033 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.390043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d77972-2df9-42fe-871d-25f40d9c9033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.406706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-26d77972-2df9-42fe-871d-25f40d9c9033 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:53.408068 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-26d77972-2df9-42fe-871d-25f40d9c9033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:53.475928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 607/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:53.499198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3e588-6165-47aa-b382-5c5c3d6df7c4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.598573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3e588-6165-47aa-b382-5c5c3d6df7c4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.634254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253f29a-60a8-4f71-bf2c-84608b1516f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.634982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253f29a-60a8-4f71-bf2c-84608b1516f1 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.635268 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253f29a-60a8-4f71-bf2c-84608b1516f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.635549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253f29a-60a8-4f71-bf2c-84608b1516f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.646960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253f29a-60a8-4f71-bf2c-84608b1516f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-c253f29a-60a8-4f71-bf2c-84608b1516f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:53.655260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:53.656384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:14:53.657330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 615/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:53.662835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d77972-2df9-42fe-871d-25f40d9c9033 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.789514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d77972-2df9-42fe-871d-25f40d9c9033 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:53.822209 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:53.835862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5e7b8-e7df-4143-a1d7-aab287c5dff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:53.836708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e7b8-e7df-4143-a1d7-aab287c5dff1 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.836995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e7b8-e7df-4143-a1d7-aab287c5dff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.837310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e7b8-e7df-4143-a1d7-aab287c5dff1 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.838437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5e7b8-e7df-4143-a1d7-aab287c5dff1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:53.838807 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5e7b8-e7df-4143-a1d7-aab287c5dff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:53.840864 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5e7b8-e7df-4143-a1d7-aab287c5dff1 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:53.855931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 608/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:53.857588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253f29a-60a8-4f71-bf2c-84608b1516f1 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:53.903484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:53.966723 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253f29a-60a8-4f71-bf2c-84608b1516f1 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.006612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8716790-e8c2-4be4-8ea2-25ccc8c5efd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.007441 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716790-e8c2-4be4-8ea2-25ccc8c5efd7 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.007891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716790-e8c2-4be4-8ea2-25ccc8c5efd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.008196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716790-e8c2-4be4-8ea2-25ccc8c5efd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.020722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8716790-e8c2-4be4-8ea2-25ccc8c5efd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.022285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8716790-e8c2-4be4-8ea2-25ccc8c5efd7 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-f8716790-e8c2-4be4-8ea2-25ccc8c5efd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:54.041621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:54.042702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:54.043741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:54.043741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:54.043741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:54.043741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:14:54.043741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 616/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:54.050899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5e7b8-e7df-4143-a1d7-aab287c5dff1 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.162538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5e7b8-e7df-4143-a1d7-aab287c5dff1 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.199628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feff17-7855-43f8-b487-cd9e5ec10e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.200356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feff17-7855-43f8-b487-cd9e5ec10e18 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.200644 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feff17-7855-43f8-b487-cd9e5ec10e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.200923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feff17-7855-43f8-b487-cd9e5ec10e18 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.201646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feff17-7855-43f8-b487-cd9e5ec10e18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:54.201958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feff17-7855-43f8-b487-cd9e5ec10e18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.203337 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feff17-7855-43f8-b487-cd9e5ec10e18 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.217733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 609/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:54.224166 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8716790-e8c2-4be4-8ea2-25ccc8c5efd7 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.327738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.335356 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8716790-e8c2-4be4-8ea2-25ccc8c5efd7 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.379188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3379a-3964-4c59-a6e2-84d33ca0c1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.380279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3379a-3964-4c59-a6e2-84d33ca0c1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.380634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3379a-3964-4c59-a6e2-84d33ca0c1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.380945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3379a-3964-4c59-a6e2-84d33ca0c1e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.389619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3379a-3964-4c59-a6e2-84d33ca0c1e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.391299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3379a-3964-4c59-a6e2-84d33ca0c1e0 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-f7b3379a-3964-4c59-a6e2-84d33ca0c1e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:54.406548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:54.407697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:54.408715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:54.408715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:54.408715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:54.408715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:54.408715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:54.408715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:54.408715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:54.408715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:54.408715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:14:54.408715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:14:54.408715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 617/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:54.414188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feff17-7855-43f8-b487-cd9e5ec10e18 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.463561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.519020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feff17-7855-43f8-b487-cd9e5ec10e18 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.555218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da4428-c8bf-467c-9407-4684aa56e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.555884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da4428-c8bf-467c-9407-4684aa56e700 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.556194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da4428-c8bf-467c-9407-4684aa56e700 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.556468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da4428-c8bf-467c-9407-4684aa56e700 None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.557293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da4428-c8bf-467c-9407-4684aa56e700 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:54.557606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da4428-c8bf-467c-9407-4684aa56e700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.559538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da4428-c8bf-467c-9407-4684aa56e700 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.578085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 610/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:54.584455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3379a-3964-4c59-a6e2-84d33ca0c1e0 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.688218 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3379a-3964-4c59-a6e2-84d33ca0c1e0 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.724493 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1a4ab-c968-48f6-aa23-599f615f29d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.725315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1a4ab-c968-48f6-aa23-599f615f29d4 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.725598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1a4ab-c968-48f6-aa23-599f615f29d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.725877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1a4ab-c968-48f6-aa23-599f615f29d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.737591 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1a4ab-c968-48f6-aa23-599f615f29d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.739029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1a4ab-c968-48f6-aa23-599f615f29d4 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-71e1a4ab-c968-48f6-aa23-599f615f29d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:54.757509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:54.758799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:54.760154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:54.760154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:54.760154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:54.760154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:14:54.760154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 618/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:54.765282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da4428-c8bf-467c-9407-4684aa56e700 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.878709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da4428-c8bf-467c-9407-4684aa56e700 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.881335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.918692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcbdd7-6460-46b9-a777-d9caa66c6239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.919448 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcbdd7-6460-46b9-a777-d9caa66c6239 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.919759 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcbdd7-6460-46b9-a777-d9caa66c6239 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.920140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcbdd7-6460-46b9-a777-d9caa66c6239 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.920954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcbdd7-6460-46b9-a777-d9caa66c6239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:54.921330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcbdd7-6460-46b9-a777-d9caa66c6239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.922902 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcbdd7-6460-46b9-a777-d9caa66c6239 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.935471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 611/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:54.941140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1a4ab-c968-48f6-aa23-599f615f29d4 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.953613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:55.049511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1a4ab-c968-48f6-aa23-599f615f29d4 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:55.084420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae70cc-0c61-4719-b245-ff9972dc5169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:55.085217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae70cc-0c61-4719-b245-ff9972dc5169 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:55.085502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae70cc-0c61-4719-b245-ff9972dc5169 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:55.085777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae70cc-0c61-4719-b245-ff9972dc5169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:55.093588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae70cc-0c61-4719-b245-ff9972dc5169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:55.095115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae70cc-0c61-4719-b245-ff9972dc5169 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-02ae70cc-0c61-4719-b245-ff9972dc5169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:55.111768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:55.112905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:55.113833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:55.113833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:55.113833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:55.113833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:55.113833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:55.113833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:55.113833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:55.113833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:14:55.113833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 619/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:55.119211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcbdd7-6460-46b9-a777-d9caa66c6239 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:55.223764 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcbdd7-6460-46b9-a777-d9caa66c6239 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:55.260817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720db28-8d1f-4ec2-9eca-0ef9442d61d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:55.261483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720db28-8d1f-4ec2-9eca-0ef9442d61d2 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:55.261790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720db28-8d1f-4ec2-9eca-0ef9442d61d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:55.262064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720db28-8d1f-4ec2-9eca-0ef9442d61d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:55.262843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720db28-8d1f-4ec2-9eca-0ef9442d61d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:55.263143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720db28-8d1f-4ec2-9eca-0ef9442d61d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:55.264618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720db28-8d1f-4ec2-9eca-0ef9442d61d2 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:55.277383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 612/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:55.283241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae70cc-0c61-4719-b245-ff9972dc5169 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:55.351703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:55.391498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae70cc-0c61-4719-b245-ff9972dc5169 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:55.427439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22ae61-96db-4e3a-9a9a-1715ae76a772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:55.428413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ae61-96db-4e3a-9a9a-1715ae76a772 None admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:55.428693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ae61-96db-4e3a-9a9a-1715ae76a772 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:55.428969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22ae61-96db-4e3a-9a9a-1715ae76a772 None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/7dde39c6d85446a681dea24573f0d6e2/roles/b8116338d60f4b38ba6e70a4726765f2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:55.445621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22ae61-96db-4e3a-9a9a-1715ae76a772 None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=7dde39c6d85446a681dea24573f0d6e2, role_id=b8116338d60f4b38ba6e70a4726765f2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:55.447119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22ae61-96db-4e3a-9a9a-1715ae76a772 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:55.461462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 620/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:55 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/7dde39c6d85446a681dea24573f0d6e2/roles/b8116338d60f4b38ba6e70a4726765f2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:57.631189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a954b-2ba2-462c-a279-8e0fb9c12c5f None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.631718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a954b-2ba2-462c-a279-8e0fb9c12c5f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.631826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a954b-2ba2-462c-a279-8e0fb9c12c5f None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.633182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 613/1233] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:57.639070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba649-bea1-483d-9e2c-2f9204be8194 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.639498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba649-bea1-483d-9e2c-2f9204be8194 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.639627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba649-bea1-483d-9e2c-2f9204be8194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.656101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c9aba649-bea1-483d-9e2c-2f9204be8194 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:57.657288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c9aba649-bea1-483d-9e2c-2f9204be8194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:57.723673 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 621/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:57.747332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a954b-2ba2-462c-a279-8e0fb9c12c5f None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.773938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:57.864651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a954b-2ba2-462c-a279-8e0fb9c12c5f None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:57.898899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aac973-8ad4-4ea2-b2e9-9d16775c2bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:57.899625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aac973-8ad4-4ea2-b2e9-9d16775c2bae None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.899953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aac973-8ad4-4ea2-b2e9-9d16775c2bae None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.900261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aac973-8ad4-4ea2-b2e9-9d16775c2bae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.912237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aac973-8ad4-4ea2-b2e9-9d16775c2bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-62aac973-8ad4-4ea2-b2e9-9d16775c2bae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:57.921126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:57.922310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:14:57.923349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 614/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:57.928253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aba649-bea1-483d-9e2c-2f9204be8194 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.976172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:58.034531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aba649-bea1-483d-9e2c-2f9204be8194 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.072068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdd294-3daf-4aa5-bb57-1e648e99bb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.072743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdd294-3daf-4aa5-bb57-1e648e99bb1a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.073019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdd294-3daf-4aa5-bb57-1e648e99bb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.073826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdd294-3daf-4aa5-bb57-1e648e99bb1a None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.074574 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdd294-3daf-4aa5-bb57-1e648e99bb1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:58.074885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdd294-3daf-4aa5-bb57-1e648e99bb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.076282 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdd294-3daf-4aa5-bb57-1e648e99bb1a None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.084926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 622/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:58.091071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aac973-8ad4-4ea2-b2e9-9d16775c2bae None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.192549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:58.209967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aac973-8ad4-4ea2-b2e9-9d16775c2bae None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.246358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05c292-8eb4-410a-8d3b-fdd7c099410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.247158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c292-8eb4-410a-8d3b-fdd7c099410e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.247460 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c292-8eb4-410a-8d3b-fdd7c099410e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.247715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c292-8eb4-410a-8d3b-fdd7c099410e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.259041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05c292-8eb4-410a-8d3b-fdd7c099410e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.260519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05c292-8eb4-410a-8d3b-fdd7c099410e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-7b05c292-8eb4-410a-8d3b-fdd7c099410e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:58.277862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:58.278918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:58.279949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:58.279949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:58.279949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:58.279949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:14:58.283729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 615/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:58.284969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdd294-3daf-4aa5-bb57-1e648e99bb1a None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.387264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdd294-3daf-4aa5-bb57-1e648e99bb1a None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.398245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:58.440365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b2019-0e00-41f2-beba-3fff8678eab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.441067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b2019-0e00-41f2-beba-3fff8678eab5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.441354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b2019-0e00-41f2-beba-3fff8678eab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.441634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b2019-0e00-41f2-beba-3fff8678eab5 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.442393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b2019-0e00-41f2-beba-3fff8678eab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:58.442891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b2019-0e00-41f2-beba-3fff8678eab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.444678 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b2019-0e00-41f2-beba-3fff8678eab5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.464616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 623/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:58.465885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05c292-8eb4-410a-8d3b-fdd7c099410e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.579571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05c292-8eb4-410a-8d3b-fdd7c099410e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.613599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc7faf-ec7c-4196-a186-224017649361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.614402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc7faf-ec7c-4196-a186-224017649361 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.614715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc7faf-ec7c-4196-a186-224017649361 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.614961 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc7faf-ec7c-4196-a186-224017649361 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.617708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:58.623079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc7faf-ec7c-4196-a186-224017649361 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.624763 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc7faf-ec7c-4196-a186-224017649361 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-22bc7faf-ec7c-4196-a186-224017649361 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:58.639829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:58.641345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:58.642298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:58.642298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:58.642298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:58.642298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:58.642298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:58.642298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:58.642298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:58.642298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:58.642298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:14:58.642298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:14:58.642298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 616/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:58.647016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b2019-0e00-41f2-beba-3fff8678eab5 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.762368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b2019-0e00-41f2-beba-3fff8678eab5 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.803541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536e17b-e555-4484-ac01-2a65ba19f8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.804244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e17b-e555-4484-ac01-2a65ba19f8cd None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.804529 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e17b-e555-4484-ac01-2a65ba19f8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.804807 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536e17b-e555-4484-ac01-2a65ba19f8cd None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:58.805681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536e17b-e555-4484-ac01-2a65ba19f8cd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:58.805960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536e17b-e555-4484-ac01-2a65ba19f8cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:58.807400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536e17b-e555-4484-ac01-2a65ba19f8cd None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:58.833074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 624/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:58.841353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc7faf-ec7c-4196-a186-224017649361 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:58.955888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc7faf-ec7c-4196-a186-224017649361 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:58.993370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e6074-116d-46df-851e-8b7ca04fe556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:58.994019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e6074-116d-46df-851e-8b7ca04fe556 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:58.994297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e6074-116d-46df-851e-8b7ca04fe556 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:58.994576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e6074-116d-46df-851e-8b7ca04fe556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.064900 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.071928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e6074-116d-46df-851e-8b7ca04fe556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.073993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e6074-116d-46df-851e-8b7ca04fe556 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.184951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 617/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:14:59.190969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536e17b-e555-4484-ac01-2a65ba19f8cd None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.221378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.296892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536e17b-e555-4484-ac01-2a65ba19f8cd None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.333274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12987537-1271-478a-b4eb-b70ee36dbbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.334268 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12987537-1271-478a-b4eb-b70ee36dbbea None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.334558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12987537-1271-478a-b4eb-b70ee36dbbea None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.334836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12987537-1271-478a-b4eb-b70ee36dbbea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.347987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12987537-1271-478a-b4eb-b70ee36dbbea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.349501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12987537-1271-478a-b4eb-b70ee36dbbea None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-12987537-1271-478a-b4eb-b70ee36dbbea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:59.368393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:59.369458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:59.370686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:59.370686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:59.370686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:59.370686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:14:59.370686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 625/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:59.375647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e6074-116d-46df-851e-8b7ca04fe556 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.478876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.485301 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e6074-116d-46df-851e-8b7ca04fe556 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.521104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ddaeb-b733-4a0f-a39c-7c4a540e9b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.521771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ddaeb-b733-4a0f-a39c-7c4a540e9b7d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.522056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ddaeb-b733-4a0f-a39c-7c4a540e9b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.522332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ddaeb-b733-4a0f-a39c-7c4a540e9b7d None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.523047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ddaeb-b733-4a0f-a39c-7c4a540e9b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:59.523354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ddaeb-b733-4a0f-a39c-7c4a540e9b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.524745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ddaeb-b733-4a0f-a39c-7c4a540e9b7d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.536710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 618/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:59.542402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12987537-1271-478a-b4eb-b70ee36dbbea None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.624745 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.649070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12987537-1271-478a-b4eb-b70ee36dbbea None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.687211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258bbc4-d666-4812-9540-c6c68831e859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.688033 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258bbc4-d666-4812-9540-c6c68831e859 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.688326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258bbc4-d666-4812-9540-c6c68831e859 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.688606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258bbc4-d666-4812-9540-c6c68831e859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.695277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258bbc4-d666-4812-9540-c6c68831e859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.696747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258bbc4-d666-4812-9540-c6c68831e859 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-6258bbc4-d666-4812-9540-c6c68831e859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:59.710897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:59.711956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:59.718547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:59.718547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:59.718547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:59.718547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:59.718547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:59.718547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:59.718547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:59.718547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:14:59.718547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 626/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:59.719151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ddaeb-b733-4a0f-a39c-7c4a540e9b7d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.828193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ddaeb-b733-4a0f-a39c-7c4a540e9b7d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:59.866019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21533fd3-0262-46da-8abd-d2e5517d403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:59.866687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21533fd3-0262-46da-8abd-d2e5517d403b None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.866973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21533fd3-0262-46da-8abd-d2e5517d403b None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.867254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21533fd3-0262-46da-8abd-d2e5517d403b None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.868060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21533fd3-0262-46da-8abd-d2e5517d403b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:59.868386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21533fd3-0262-46da-8abd-d2e5517d403b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:59.869834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21533fd3-0262-46da-8abd-d2e5517d403b None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:59.882571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 619/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:59.888613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258bbc4-d666-4812-9540-c6c68831e859 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.001710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258bbc4-d666-4812-9540-c6c68831e859 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.042494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50588df9-148c-44c8-9c96-8d69a696274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.043146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50588df9-148c-44c8-9c96-8d69a696274b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.043553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50588df9-148c-44c8-9c96-8d69a696274b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.043830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50588df9-148c-44c8-9c96-8d69a696274b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.044694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50588df9-148c-44c8-9c96-8d69a696274b None admin] RBAC: Adding query filter params (role.id=b8116338d60f4b38ba6e70a4726765f2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=7dde39c6d85446a681dea24573f0d6e2) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:00.045011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50588df9-148c-44c8-9c96-8d69a696274b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.046438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50588df9-148c-44c8-9c96-8d69a696274b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.053238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 627/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/role_assignments?user.id=7dde39c6d85446a681dea24573f0d6e2&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=b8116338d60f4b38ba6e70a4726765f2 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:02.268204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834f2b-b0f4-4c8e-b789-ae1ce8015b63 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.268966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834f2b-b0f4-4c8e-b789-ae1ce8015b63 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.268966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50834f2b-b0f4-4c8e-b789-ae1ce8015b63 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.270061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 620/1247] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:02.275185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd890a09-ae9a-4ea6-a1e4-2b9abb3133cc None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.275611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd890a09-ae9a-4ea6-a1e4-2b9abb3133cc None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.275738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd890a09-ae9a-4ea6-a1e4-2b9abb3133cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.281265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:02.294667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-cd890a09-ae9a-4ea6-a1e4-2b9abb3133cc None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:02.295853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-cd890a09-ae9a-4ea6-a1e4-2b9abb3133cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:02.365524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 628/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:02.389188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50834f2b-b0f4-4c8e-b789-ae1ce8015b63 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:02.409600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:02.514333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50834f2b-b0f4-4c8e-b789-ae1ce8015b63 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:02.550640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c12df-ccea-435b-96d6-d478799c30bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:02.551339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c12df-ccea-435b-96d6-d478799c30bc None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.551621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c12df-ccea-435b-96d6-d478799c30bc None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.551894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c12df-ccea-435b-96d6-d478799c30bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.564268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c12df-ccea-435b-96d6-d478799c30bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-0a2c12df-ccea-435b-96d6-d478799c30bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:02.572084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:02.573743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:15:02.574603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 621/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:02.579829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd890a09-ae9a-4ea6-a1e4-2b9abb3133cc None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:02.691949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd890a09-ae9a-4ea6-a1e4-2b9abb3133cc None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:02.722747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:02.728480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127e676-2791-46fc-a18d-a286974afb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:02.729988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127e676-2791-46fc-a18d-a286974afb3f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.730265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127e676-2791-46fc-a18d-a286974afb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.730625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127e676-2791-46fc-a18d-a286974afb3f None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.731457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127e676-2791-46fc-a18d-a286974afb3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:02.731821 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127e676-2791-46fc-a18d-a286974afb3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:02.733388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127e676-2791-46fc-a18d-a286974afb3f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:02.742289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 629/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:02.748126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c12df-ccea-435b-96d6-d478799c30bc None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:02.840467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:02.872837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c12df-ccea-435b-96d6-d478799c30bc None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:02.910499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2b0b-91cb-4b0b-96c2-124845caf726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:02.911463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2b0b-91cb-4b0b-96c2-124845caf726 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.911925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2b0b-91cb-4b0b-96c2-124845caf726 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.912238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2b0b-91cb-4b0b-96c2-124845caf726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.923553 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa2b0b-91cb-4b0b-96c2-124845caf726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:02.925039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa2b0b-91cb-4b0b-96c2-124845caf726 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-bfaa2b0b-91cb-4b0b-96c2-124845caf726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:02.942447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:02.943583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:02.949633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:02.949633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:02.949633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:02.949633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:15:02.949633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 622/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:02.950261 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127e676-2791-46fc-a18d-a286974afb3f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.068544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127e676-2791-46fc-a18d-a286974afb3f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.106135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae657270-1d58-414e-92e0-29dbdfda77fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.106878 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae657270-1d58-414e-92e0-29dbdfda77fa None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.107155 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae657270-1d58-414e-92e0-29dbdfda77fa None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.107437 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae657270-1d58-414e-92e0-29dbdfda77fa None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.108193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae657270-1d58-414e-92e0-29dbdfda77fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:03.108573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae657270-1d58-414e-92e0-29dbdfda77fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.109988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae657270-1d58-414e-92e0-29dbdfda77fa None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.123854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 630/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:03.128065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2b0b-91cb-4b0b-96c2-124845caf726 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.231439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2b0b-91cb-4b0b-96c2-124845caf726 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.259437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:03.269075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b65e2-48b2-44a1-aaf7-5829bb57d133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.269979 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b65e2-48b2-44a1-aaf7-5829bb57d133 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.270296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b65e2-48b2-44a1-aaf7-5829bb57d133 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.270625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b65e2-48b2-44a1-aaf7-5829bb57d133 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.279100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b65e2-48b2-44a1-aaf7-5829bb57d133 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.280565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b65e2-48b2-44a1-aaf7-5829bb57d133 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-0b7b65e2-48b2-44a1-aaf7-5829bb57d133 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:03.296475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:03.297728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:03.298884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:03.298884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:03.298884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:03.298884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:03.298884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:03.298884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:03.298884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:03.298884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:03.298884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:15:03.298884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:15:03.298884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 623/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:03.303581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae657270-1d58-414e-92e0-29dbdfda77fa None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.362734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:03.409575 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae657270-1d58-414e-92e0-29dbdfda77fa None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.443109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e627-d6e9-47d8-82bc-0800a42fbdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.443816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e627-d6e9-47d8-82bc-0800a42fbdb2 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.444097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e627-d6e9-47d8-82bc-0800a42fbdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.444395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344e627-d6e9-47d8-82bc-0800a42fbdb2 None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.445202 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344e627-d6e9-47d8-82bc-0800a42fbdb2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:03.445513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344e627-d6e9-47d8-82bc-0800a42fbdb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.446947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344e627-d6e9-47d8-82bc-0800a42fbdb2 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.467093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 631/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 16 00:15:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:03.472919 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b65e2-48b2-44a1-aaf7-5829bb57d133 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.581379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b65e2-48b2-44a1-aaf7-5829bb57d133 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.618308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c7be3-71df-4e9d-b8cc-1cc621fc18d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.618895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c7be3-71df-4e9d-b8cc-1cc621fc18d0 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.619186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c7be3-71df-4e9d-b8cc-1cc621fc18d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.619467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c7be3-71df-4e9d-b8cc-1cc621fc18d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.683140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:03.697209 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c7be3-71df-4e9d-b8cc-1cc621fc18d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.698867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c7be3-71df-4e9d-b8cc-1cc621fc18d0 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.808471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 624/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:03.814474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e627-d6e9-47d8-82bc-0800a42fbdb2 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.926086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344e627-d6e9-47d8-82bc-0800a42fbdb2 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.941003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:03.963258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e0404-8f29-4f4c-885b-b1f96a6a167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.964131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e0404-8f29-4f4c-885b-b1f96a6a167b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.964416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e0404-8f29-4f4c-885b-b1f96a6a167b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.964692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e0404-8f29-4f4c-885b-b1f96a6a167b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.975298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e0404-8f29-4f4c-885b-b1f96a6a167b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.976783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e0404-8f29-4f4c-885b-b1f96a6a167b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-1e1e0404-8f29-4f4c-885b-b1f96a6a167b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:03.995440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:03.996618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:03.997645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:03.997645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:03.997645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:03.997645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:03.997645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 632/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:15:04.002730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c7be3-71df-4e9d-b8cc-1cc621fc18d0 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.095464 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:04.108535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c7be3-71df-4e9d-b8cc-1cc621fc18d0 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.144815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca9e5-c7c8-4b19-936b-5e4233138d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.145545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca9e5-c7c8-4b19-936b-5e4233138d22 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.145827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca9e5-c7c8-4b19-936b-5e4233138d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.146099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccca9e5-c7c8-4b19-936b-5e4233138d22 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.146835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca9e5-c7c8-4b19-936b-5e4233138d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:04.147144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca9e5-c7c8-4b19-936b-5e4233138d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:04.148559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccca9e5-c7c8-4b19-936b-5e4233138d22 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:04.160963 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 625/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:04.166580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e0404-8f29-4f4c-885b-b1f96a6a167b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.267103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e0404-8f29-4f4c-885b-b1f96a6a167b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.301535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf1bca-7759-4989-ab5d-2855674c2832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.302335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1bca-7759-4989-ab5d-2855674c2832 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.302624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1bca-7759-4989-ab5d-2855674c2832 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.302904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1bca-7759-4989-ab5d-2855674c2832 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.310375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf1bca-7759-4989-ab5d-2855674c2832 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:04.311899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf1bca-7759-4989-ab5d-2855674c2832 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-facf1bca-7759-4989-ab5d-2855674c2832 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:04.325701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:04.326798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:04.327850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:04.327850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:04.327850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:04.327850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:04.327850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:04.327850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:04.327850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:04.327850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:04.327850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 633/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:04.332872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca9e5-c7c8-4b19-936b-5e4233138d22 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.431905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccca9e5-c7c8-4b19-936b-5e4233138d22 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.464799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292133f7-6d81-43ca-a055-45cd6363335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.465451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292133f7-6d81-43ca-a055-45cd6363335f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.465737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292133f7-6d81-43ca-a055-45cd6363335f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.466017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292133f7-6d81-43ca-a055-45cd6363335f None admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.466799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292133f7-6d81-43ca-a055-45cd6363335f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:04.467111 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292133f7-6d81-43ca-a055-45cd6363335f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:04.468571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292133f7-6d81-43ca-a055-45cd6363335f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:04.480576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 626/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:04.486583 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf1bca-7759-4989-ab5d-2855674c2832 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:04.511792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:04.590059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf1bca-7759-4989-ab5d-2855674c2832 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:04.622127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fe12e-d6c9-4a81-bacf-2be66a3160a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:04.622757 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fe12e-d6c9-4a81-bacf-2be66a3160a3 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:04.623039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fe12e-d6c9-4a81-bacf-2be66a3160a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:04.623312 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fe12e-d6c9-4a81-bacf-2be66a3160a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:04.624154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fe12e-d6c9-4a81-bacf-2be66a3160a3 None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=7dde39c6d85446a681dea24573f0d6e2) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:04.624473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fe12e-d6c9-4a81-bacf-2be66a3160a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:04.625892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fe12e-d6c9-4a81-bacf-2be66a3160a3 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:04.631095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 634/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:04 2022] GET /identity/v3/role_assignments?user.id=7dde39c6d85446a681dea24573f0d6e2&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:06.701618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069eae-3d16-4bdc-b1ef-2e38c97abbd0 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.702208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069eae-3d16-4bdc-b1ef-2e38c97abbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.702208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069eae-3d16-4bdc-b1ef-2e38c97abbd0 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.703540 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 627/1261] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:06.708741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a946-1677-41e8-ae72-0832b91930f0 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.709171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a946-1677-41e8-ae72-0832b91930f0 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.709315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773a946-1677-41e8-ae72-0832b91930f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.726354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f773a946-1677-41e8-ae72-0832b91930f0 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:06.727543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f773a946-1677-41e8-ae72-0832b91930f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:06.792775 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 635/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:06.818026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e069eae-3d16-4bdc-b1ef-2e38c97abbd0 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:06.831395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:06.927010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e069eae-3d16-4bdc-b1ef-2e38c97abbd0 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:06.959588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0f3d2-cf5a-4749-8741-ec66999c79d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:06.960344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0f3d2-cf5a-4749-8741-ec66999c79d4 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:06.960634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0f3d2-cf5a-4749-8741-ec66999c79d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:06.960915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0f3d2-cf5a-4749-8741-ec66999c79d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:06.970998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0f3d2-cf5a-4749-8741-ec66999c79d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-d8f0f3d2-cf5a-4749-8741-ec66999c79d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:06.978702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:06.980265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:15:06.981286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 628/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:06.986642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773a946-1677-41e8-ae72-0832b91930f0 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.004916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.085402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773a946-1677-41e8-ae72-0832b91930f0 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.118274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe2dde-bd7d-42e1-816f-84b8b64c4837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.118934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe2dde-bd7d-42e1-816f-84b8b64c4837 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.119222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe2dde-bd7d-42e1-816f-84b8b64c4837 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.119504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe2dde-bd7d-42e1-816f-84b8b64c4837 None admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.120811 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe2dde-bd7d-42e1-816f-84b8b64c4837 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:07.121127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe2dde-bd7d-42e1-816f-84b8b64c4837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.122511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe2dde-bd7d-42e1-816f-84b8b64c4837 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.130321 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 636/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:07.136610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0f3d2-cf5a-4749-8741-ec66999c79d4 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.210327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.243334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0f3d2-cf5a-4749-8741-ec66999c79d4 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.275903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba67900-117e-4317-a394-ffb18fbfff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.276782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67900-117e-4317-a394-ffb18fbfff08 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.277069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67900-117e-4317-a394-ffb18fbfff08 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.277347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67900-117e-4317-a394-ffb18fbfff08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.287411 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba67900-117e-4317-a394-ffb18fbfff08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.288879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba67900-117e-4317-a394-ffb18fbfff08 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-5ba67900-117e-4317-a394-ffb18fbfff08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:07.305501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:07.306379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:07.307840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:07.307840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:07.307840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:07.307840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:15:07.307840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 629/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:07.313006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe2dde-bd7d-42e1-816f-84b8b64c4837 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.390862 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.408978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe2dde-bd7d-42e1-816f-84b8b64c4837 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.440797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a123cf3-bec6-4f3e-baa3-8914639def83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.441442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a123cf3-bec6-4f3e-baa3-8914639def83 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.441724 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a123cf3-bec6-4f3e-baa3-8914639def83 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.441997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a123cf3-bec6-4f3e-baa3-8914639def83 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.442701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a123cf3-bec6-4f3e-baa3-8914639def83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:07.443008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a123cf3-bec6-4f3e-baa3-8914639def83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.444389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a123cf3-bec6-4f3e-baa3-8914639def83 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.456541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 637/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:07.462284 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba67900-117e-4317-a394-ffb18fbfff08 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.560262 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba67900-117e-4317-a394-ffb18fbfff08 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.579367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.594184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12492369-b247-4563-9091-3034a7d831d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.594971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492369-b247-4563-9091-3034a7d831d9 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.595255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492369-b247-4563-9091-3034a7d831d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.595528 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492369-b247-4563-9091-3034a7d831d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.602752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12492369-b247-4563-9091-3034a7d831d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.604351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12492369-b247-4563-9091-3034a7d831d9 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-12492369-b247-4563-9091-3034a7d831d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:07.618072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:07.619196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:07.620446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:07.620446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:07.620446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:07.620446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:07.620446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:07.620446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:07.620446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:07.620446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:07.620446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:15:07.620446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:15:07.620446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 630/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:07.625039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a123cf3-bec6-4f3e-baa3-8914639def83 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.721274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a123cf3-bec6-4f3e-baa3-8914639def83 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.753950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451c671-d3b0-4557-91a0-cd6a413b885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.754612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c671-d3b0-4557-91a0-cd6a413b885e None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.754895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c671-d3b0-4557-91a0-cd6a413b885e None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.755170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c671-d3b0-4557-91a0-cd6a413b885e None admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.756043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451c671-d3b0-4557-91a0-cd6a413b885e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:07.756391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451c671-d3b0-4557-91a0-cd6a413b885e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.757809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451c671-d3b0-4557-91a0-cd6a413b885e None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.766797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:07.775346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 638/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:07.781625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12492369-b247-4563-9091-3034a7d831d9 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:07.889992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12492369-b247-4563-9091-3034a7d831d9 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:07.921662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6f557-4ec5-47d2-98a2-c8918a78af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:07.922445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6f557-4ec5-47d2-98a2-c8918a78af4c None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.922729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6f557-4ec5-47d2-98a2-c8918a78af4c None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.923006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6f557-4ec5-47d2-98a2-c8918a78af4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.933648 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6f557-4ec5-47d2-98a2-c8918a78af4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:07.935085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6f557-4ec5-47d2-98a2-c8918a78af4c None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-eea6f557-4ec5-47d2-98a2-c8918a78af4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:07.952292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:07.953356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:07.954630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:07.954630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:07.954630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:07.954630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:15:07.954630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 631/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:07.959089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451c671-d3b0-4557-91a0-cd6a413b885e None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.055864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451c671-d3b0-4557-91a0-cd6a413b885e None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.090159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9a995-76d1-4234-a813-f0691c2510eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.090813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9a995-76d1-4234-a813-f0691c2510eb None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.091100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9a995-76d1-4234-a813-f0691c2510eb None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.091378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9a995-76d1-4234-a813-f0691c2510eb None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.092121 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9a995-76d1-4234-a813-f0691c2510eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:08.092430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9a995-76d1-4234-a813-f0691c2510eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.093794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9a995-76d1-4234-a813-f0691c2510eb None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.104692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 639/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:08.110361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6f557-4ec5-47d2-98a2-c8918a78af4c None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.143733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.210637 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6f557-4ec5-47d2-98a2-c8918a78af4c None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.242693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c6af2-ed4f-45fd-a8a8-fad41f03ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.243480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6af2-ed4f-45fd-a8a8-fad41f03ddcb None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.243761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6af2-ed4f-45fd-a8a8-fad41f03ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.244060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6af2-ed4f-45fd-a8a8-fad41f03ddcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.250529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c6af2-ed4f-45fd-a8a8-fad41f03ddcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.252011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c6af2-ed4f-45fd-a8a8-fad41f03ddcb None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-a80c6af2-ed4f-45fd-a8a8-fad41f03ddcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:08.266610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:08.267656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:08.268904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:08.268904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:08.268904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:08.268904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:08.268904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:08.268904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:08.268904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:08.268904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:15:08.268904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 632/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:08.273703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9a995-76d1-4234-a813-f0691c2510eb None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.329435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.369507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9a995-76d1-4234-a813-f0691c2510eb None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.401039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4029067-4525-40b3-a028-2a3db292c5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.401677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4029067-4525-40b3-a028-2a3db292c5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.401961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4029067-4525-40b3-a028-2a3db292c5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.402238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4029067-4525-40b3-a028-2a3db292c5c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.403008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4029067-4525-40b3-a028-2a3db292c5c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:08.403321 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4029067-4525-40b3-a028-2a3db292c5c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.404759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4029067-4525-40b3-a028-2a3db292c5c6 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.416870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 640/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:08.422543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c6af2-ed4f-45fd-a8a8-fad41f03ddcb None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.509384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.518072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c6af2-ed4f-45fd-a8a8-fad41f03ddcb None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.550229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace5281-378d-4c37-8072-304e6d992f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.551038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace5281-378d-4c37-8072-304e6d992f5e None admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.551321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace5281-378d-4c37-8072-304e6d992f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.551592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace5281-378d-4c37-8072-304e6d992f5e None admin] PATH_INFO: `/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/7dde39c6d85446a681dea24573f0d6e2/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.553533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace5281-378d-4c37-8072-304e6d992f5e None admin] RBAC: Authorizing `identity:create_grant(project_id=72db4b8f1ac74714add3893ac61f7d8a, user_id=7dde39c6d85446a681dea24573f0d6e2, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.554939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace5281-378d-4c37-8072-304e6d992f5e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.567051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 633/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:08 2022] PUT /identity/v3/projects/72db4b8f1ac74714add3893ac61f7d8a/users/7dde39c6d85446a681dea24573f0d6e2/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:10.650312 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae46e8-f79d-4c2a-975e-7710e0c24108 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:10.650939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae46e8-f79d-4c2a-975e-7710e0c24108 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:10.650939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae46e8-f79d-4c2a-975e-7710e0c24108 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:10.652346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 641/1274] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:10.657328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012eae0-d51a-4c69-a2ad-87257fe80d59 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:10.657700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012eae0-d51a-4c69-a2ad-87257fe80d59 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:10.657895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012eae0-d51a-4c69-a2ad-87257fe80d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:10.674638 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-9012eae0-d51a-4c69-a2ad-87257fe80d59 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:10.675810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9012eae0-d51a-4c69-a2ad-87257fe80d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:10.740121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 634/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:10.763460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae46e8-f79d-4c2a-975e-7710e0c24108 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:10.867534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae46e8-f79d-4c2a-975e-7710e0c24108 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:10.884642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:10.901728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c76f-ffc8-4a23-8953-da5d5e9f451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:10.902455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c76f-ffc8-4a23-8953-da5d5e9f451a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:10.902744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c76f-ffc8-4a23-8953-da5d5e9f451a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:10.903022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7c76f-ffc8-4a23-8953-da5d5e9f451a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:10.912906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7c76f-ffc8-4a23-8953-da5d5e9f451a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-9dc7c76f-ffc8-4a23-8953-da5d5e9f451a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:10.920630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:10.921728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:10.922613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 642/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:10.927763 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012eae0-d51a-4c69-a2ad-87257fe80d59 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.006046 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.025395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012eae0-d51a-4c69-a2ad-87257fe80d59 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.058127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ada85-c59c-4637-ac8d-0092f0f45c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.058784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ada85-c59c-4637-ac8d-0092f0f45c30 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.059069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ada85-c59c-4637-ac8d-0092f0f45c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.059348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ada85-c59c-4637-ac8d-0092f0f45c30 None admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.060118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ada85-c59c-4637-ac8d-0092f0f45c30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:11.060433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ada85-c59c-4637-ac8d-0092f0f45c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.061800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ada85-c59c-4637-ac8d-0092f0f45c30 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.069537 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 635/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:11.075876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c76f-ffc8-4a23-8953-da5d5e9f451a None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.171142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7c76f-ffc8-4a23-8953-da5d5e9f451a None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.203570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e7980-9a8d-492c-865a-fd8c6b8762e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.204385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e7980-9a8d-492c-865a-fd8c6b8762e4 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.204675 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e7980-9a8d-492c-865a-fd8c6b8762e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.204954 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e7980-9a8d-492c-865a-fd8c6b8762e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.215363 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e7980-9a8d-492c-865a-fd8c6b8762e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.216821 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e7980-9a8d-492c-865a-fd8c6b8762e4 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-d74e7980-9a8d-492c-865a-fd8c6b8762e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:11.233848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:11.234875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:11.235957 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:11.235957 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:11.235957 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:11.235957 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:11.235957 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 643/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:11.240595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ada85-c59c-4637-ac8d-0092f0f45c30 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.336547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ada85-c59c-4637-ac8d-0092f0f45c30 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.368601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1805f8-7552-48a8-ac58-cb5d3de5f299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.369247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1805f8-7552-48a8-ac58-cb5d3de5f299 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.369633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1805f8-7552-48a8-ac58-cb5d3de5f299 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.369912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1805f8-7552-48a8-ac58-cb5d3de5f299 None admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.370621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1805f8-7552-48a8-ac58-cb5d3de5f299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:11.370930 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1805f8-7552-48a8-ac58-cb5d3de5f299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.372311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1805f8-7552-48a8-ac58-cb5d3de5f299 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.383478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 636/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:11.389495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e7980-9a8d-492c-865a-fd8c6b8762e4 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.419727 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.486883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e7980-9a8d-492c-865a-fd8c6b8762e4 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.519108 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc99111-0729-4045-b089-cbb7d39b7ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.519893 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99111-0729-4045-b089-cbb7d39b7ebc None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.520208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99111-0729-4045-b089-cbb7d39b7ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.520488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99111-0729-4045-b089-cbb7d39b7ebc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.528335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc99111-0729-4045-b089-cbb7d39b7ebc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.529768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc99111-0729-4045-b089-cbb7d39b7ebc None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-ddc99111-0729-4045-b089-cbb7d39b7ebc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:15:11.543976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:11.545057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:11.546041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:11.546041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:11.546041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:15:11.546041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:15:11.546041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:15:11.546041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:15:11.546041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:15:11.546041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:15:11.546041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:15:11.546041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:11.546041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 644/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:11.550834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1805f8-7552-48a8-ac58-cb5d3de5f299 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.554658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.648055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1805f8-7552-48a8-ac58-cb5d3de5f299 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.680399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d258a-96b1-468f-9ee3-9e8340b285de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.681059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d258a-96b1-468f-9ee3-9e8340b285de None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.681342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d258a-96b1-468f-9ee3-9e8340b285de None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.681617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d258a-96b1-468f-9ee3-9e8340b285de None admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.682986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d258a-96b1-468f-9ee3-9e8340b285de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:11.683299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d258a-96b1-468f-9ee3-9e8340b285de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.684754 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d258a-96b1-468f-9ee3-9e8340b285de None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.701505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 637/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:11.707223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc99111-0729-4045-b089-cbb7d39b7ebc None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.794139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.804693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc99111-0729-4045-b089-cbb7d39b7ebc None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.850163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4ab61-d4d2-4037-b5cf-1a6805c76634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.850816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ab61-d4d2-4037-b5cf-1a6805c76634 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.851107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ab61-d4d2-4037-b5cf-1a6805c76634 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.851391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ab61-d4d2-4037-b5cf-1a6805c76634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.916045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4ab61-d4d2-4037-b5cf-1a6805c76634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.917497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4ab61-d4d2-4037-b5cf-1a6805c76634 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.001642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:12.014331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 645/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:12.020174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d258a-96b1-468f-9ee3-9e8340b285de None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.079561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:12.117003 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d258a-96b1-468f-9ee3-9e8340b285de None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.149376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc1d2f-5cd1-4dca-aa1f-f710f045374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.150161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc1d2f-5cd1-4dca-aa1f-f710f045374e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.150450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc1d2f-5cd1-4dca-aa1f-f710f045374e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.151363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc1d2f-5cd1-4dca-aa1f-f710f045374e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.161232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc1d2f-5cd1-4dca-aa1f-f710f045374e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.162703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc1d2f-5cd1-4dca-aa1f-f710f045374e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-b9fc1d2f-5cd1-4dca-aa1f-f710f045374e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:12.180069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:12.181195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:12.182805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:15:12.182805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:12.182805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:15:12.182805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:15:12.182805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 638/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:12.187136 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4ab61-d4d2-4037-b5cf-1a6805c76634 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.289372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4ab61-d4d2-4037-b5cf-1a6805c76634 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.322171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e762f3-7021-477b-b18e-300578c3eba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.323353 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e762f3-7021-477b-b18e-300578c3eba5 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.323640 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e762f3-7021-477b-b18e-300578c3eba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.323918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e762f3-7021-477b-b18e-300578c3eba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.324666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e762f3-7021-477b-b18e-300578c3eba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:12.324976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e762f3-7021-477b-b18e-300578c3eba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.326336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e762f3-7021-477b-b18e-300578c3eba5 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.337295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 646/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 16 00:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:12.343096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc1d2f-5cd1-4dca-aa1f-f710f045374e None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.439658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc1d2f-5cd1-4dca-aa1f-f710f045374e None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.453090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:12.473564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c15944-a383-458e-8b92-4e9e9f699f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.474344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15944-a383-458e-8b92-4e9e9f699f8d None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.474632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15944-a383-458e-8b92-4e9e9f699f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.474913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c15944-a383-458e-8b92-4e9e9f699f8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.481516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c15944-a383-458e-8b92-4e9e9f699f8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.482941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c15944-a383-458e-8b92-4e9e9f699f8d None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application [None req-41c15944-a383-458e-8b92-4e9e9f699f8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:15:12.497361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:12.498373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:12.499591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:15:12.499591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:15:12.499591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:12.499591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:12.499591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:12.499591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:12.499591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:15:12.499591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: ERROR keystone.server.flask.application Jun 16 00:15:12.499591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 639/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 16 00:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:12.504306 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e762f3-7021-477b-b18e-300578c3eba5 None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.552814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:12.601787 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e762f3-7021-477b-b18e-300578c3eba5 None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.633582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24f023-2d18-4ec3-91ac-a8c9e6bf6871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.634223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24f023-2d18-4ec3-91ac-a8c9e6bf6871 None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.634505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24f023-2d18-4ec3-91ac-a8c9e6bf6871 None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.634782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24f023-2d18-4ec3-91ac-a8c9e6bf6871 None admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.635581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24f023-2d18-4ec3-91ac-a8c9e6bf6871 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:12.635891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24f023-2d18-4ec3-91ac-a8c9e6bf6871 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.637341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24f023-2d18-4ec3-91ac-a8c9e6bf6871 None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.648699 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 647/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 16 00:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:12.655340 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c15944-a383-458e-8b92-4e9e9f699f8d None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:12.753487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c15944-a383-458e-8b92-4e9e9f699f8d None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:12.785376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08948df0-d773-410f-99a9-b0dfb8b3f5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:12.786011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948df0-d773-410f-99a9-b0dfb8b3f5eb None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:12.786298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948df0-d773-410f-99a9-b0dfb8b3f5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:12.786580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948df0-d773-410f-99a9-b0dfb8b3f5eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:12.787402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08948df0-d773-410f-99a9-b0dfb8b3f5eb None admin] RBAC: Adding query filter params (role.id=9eb6a7e444724b218f6b26eb4ec234c2, scope.project.id=72db4b8f1ac74714add3893ac61f7d8a, user.id=7dde39c6d85446a681dea24573f0d6e2) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:12.787719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08948df0-d773-410f-99a9-b0dfb8b3f5eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:12.789160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08948df0-d773-410f-99a9-b0dfb8b3f5eb None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:12.798896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 640/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:12 2022] GET /identity/v3/role_assignments?user.id=7dde39c6d85446a681dea24573f0d6e2&scope.project.id=72db4b8f1ac74714add3893ac61f7d8a&role.id=9eb6a7e444724b218f6b26eb4ec234c2 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:14.885691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddcc4-3642-4111-b653-bbae89e64ff5 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:14.886246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddcc4-3642-4111-b653-bbae89e64ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:14.886246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddcc4-3642-4111-b653-bbae89e64ff5 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:14.887609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 648/1288] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:14.892549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e904ced-a89f-46b0-958d-b2116169eb05 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:14.892965 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e904ced-a89f-46b0-958d-b2116169eb05 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:14.893101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e904ced-a89f-46b0-958d-b2116169eb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:14.909765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-9e904ced-a89f-46b0-958d-b2116169eb05 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:14.910928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9e904ced-a89f-46b0-958d-b2116169eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:14.939173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:14.974700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 641/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:14.996271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdddcc4-3642-4111-b653-bbae89e64ff5 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:15.095366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdddcc4-3642-4111-b653-bbae89e64ff5 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:15.105646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:15.128441 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310fada-58e1-47fc-8948-c461485c429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:15.129230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310fada-58e1-47fc-8948-c461485c429f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.129521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310fada-58e1-47fc-8948-c461485c429f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.129805 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310fada-58e1-47fc-8948-c461485c429f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.130455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310fada-58e1-47fc-8948-c461485c429f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:15.131828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310fada-58e1-47fc-8948-c461485c429f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-7310fada-58e1-47fc-8948-c461485c429f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:15.144096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:15.145311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:15.146225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 649/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 16 00:15:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:15.151774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e904ced-a89f-46b0-958d-b2116169eb05 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:15.245540 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e904ced-a89f-46b0-958d-b2116169eb05 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:15.278014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930edf2d-fdb1-4e89-9713-4af68c34157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:15.278660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930edf2d-fdb1-4e89-9713-4af68c34157f None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.278943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930edf2d-fdb1-4e89-9713-4af68c34157f None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.279221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930edf2d-fdb1-4e89-9713-4af68c34157f None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.279917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930edf2d-fdb1-4e89-9713-4af68c34157f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:15.280257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930edf2d-fdb1-4e89-9713-4af68c34157f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:15.281604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930edf2d-fdb1-4e89-9713-4af68c34157f None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:15.286241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 642/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jun 16 00:15:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:15.291802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310fada-58e1-47fc-8948-c461485c429f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:15.389284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310fada-58e1-47fc-8948-c461485c429f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:15.421441 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793fef5-bc68-42b1-a066-857b4f8985fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:15.422031 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793fef5-bc68-42b1-a066-857b4f8985fa None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.422318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793fef5-bc68-42b1-a066-857b4f8985fa None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.422598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793fef5-bc68-42b1-a066-857b4f8985fa None admin] PATH_INFO: `/v3/services` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.423297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793fef5-bc68-42b1-a066-857b4f8985fa None admin] RBAC: Adding query filter params (type=placement) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:15.423610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793fef5-bc68-42b1-a066-857b4f8985fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:15.424991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793fef5-bc68-42b1-a066-857b4f8985fa None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:15.429298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 650/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jun 16 00:15:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:17.490713 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b12f3-8b40-43a6-8727-b9cb741a39c5 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.491283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b12f3-8b40-43a6-8727-b9cb741a39c5 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.491283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b12f3-8b40-43a6-8727-b9cb741a39c5 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.492658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 643/1293] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:17.498508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e409f-42cf-418f-8666-3cff2881b9b1 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.498908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e409f-42cf-418f-8666-3cff2881b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.499099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e409f-42cf-418f-8666-3cff2881b9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.515361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-cb4e409f-42cf-418f-8666-3cff2881b9b1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:17.516579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-cb4e409f-42cf-418f-8666-3cff2881b9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:17.547202 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.585491 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 651/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:17.608779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b12f3-8b40-43a6-8727-b9cb741a39c5 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.638792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.706980 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b12f3-8b40-43a6-8727-b9cb741a39c5 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.738567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e38a5-be33-4d1d-a192-e5dc0760eeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.739213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e38a5-be33-4d1d-a192-e5dc0760eeaf None admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.739493 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e38a5-be33-4d1d-a192-e5dc0760eeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.739764 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e38a5-be33-4d1d-a192-e5dc0760eeaf None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.740500 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e38a5-be33-4d1d-a192-e5dc0760eeaf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.741895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e38a5-be33-4d1d-a192-e5dc0760eeaf None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:17.754656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 644/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 16 00:15:17 2022] POST /identity/v3/services => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:19.827120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912644d2-b368-409c-b2ce-02aa72c3cf72 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.827647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912644d2-b368-409c-b2ce-02aa72c3cf72 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.827726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912644d2-b368-409c-b2ce-02aa72c3cf72 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.829199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 652/1296] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:19.835711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f126a4d-3308-4044-9428-f0ae83b50d23 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:19.836154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f126a4d-3308-4044-9428-f0ae83b50d23 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:19.836439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f126a4d-3308-4044-9428-f0ae83b50d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:19.853125 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0f126a4d-3308-4044-9428-f0ae83b50d23 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:19.854816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0f126a4d-3308-4044-9428-f0ae83b50d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:19.924974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 645/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:19.952130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912644d2-b368-409c-b2ce-02aa72c3cf72 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:20.050348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912644d2-b368-409c-b2ce-02aa72c3cf72 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.084653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e0130-f0b9-4a71-9ff5-651ec8d08d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.085391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e0130-f0b9-4a71-9ff5-651ec8d08d7b None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.085680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e0130-f0b9-4a71-9ff5-651ec8d08d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.085962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e0130-f0b9-4a71-9ff5-651ec8d08d7b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.086619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e0130-f0b9-4a71-9ff5-651ec8d08d7b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.088330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e0130-f0b9-4a71-9ff5-651ec8d08d7b None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-b43e0130-f0b9-4a71-9ff5-651ec8d08d7b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:20.100062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:20.101220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:20.106944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 653/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 16 00:15:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:20.107930 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f126a4d-3308-4044-9428-f0ae83b50d23 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:20.125186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:20.202932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f126a4d-3308-4044-9428-f0ae83b50d23 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.236702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c594d56-0941-43cc-9a93-c22f681a07a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.237362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594d56-0941-43cc-9a93-c22f681a07a6 None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.237650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594d56-0941-43cc-9a93-c22f681a07a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.237930 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594d56-0941-43cc-9a93-c22f681a07a6 None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.238636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c594d56-0941-43cc-9a93-c22f681a07a6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:20.238947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c594d56-0941-43cc-9a93-c22f681a07a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.240341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c594d56-0941-43cc-9a93-c22f681a07a6 None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.245586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 646/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jun 16 00:15:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:20.251419 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e0130-f0b9-4a71-9ff5-651ec8d08d7b None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:20.282900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:20.349146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e0130-f0b9-4a71-9ff5-651ec8d08d7b None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.380525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810be2f-4834-4f37-b863-27cbf9aaaa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.381164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810be2f-4834-4f37-b863-27cbf9aaaa4a None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.381449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810be2f-4834-4f37-b863-27cbf9aaaa4a None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.381725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810be2f-4834-4f37-b863-27cbf9aaaa4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.382504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810be2f-4834-4f37-b863-27cbf9aaaa4a None admin] RBAC: Adding query filter params (interface=public, service_id=fcb2c38d3f8f43af861a617de5b00ec1, region_id=RegionOne) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:20.382820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810be2f-4834-4f37-b863-27cbf9aaaa4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.384198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810be2f-4834-4f37-b863-27cbf9aaaa4a None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.389565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 654/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 16 00:15:20 2022] GET /identity/v3/endpoints?service_id=fcb2c38d3f8f43af861a617de5b00ec1&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:20.395063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c594d56-0941-43cc-9a93-c22f681a07a6 None admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:20.474365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:20.492768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c594d56-0941-43cc-9a93-c22f681a07a6 None admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.526735 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381d688-2573-4366-b4a6-76b91c9ca42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.527387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381d688-2573-4366-b4a6-76b91c9ca42e None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.527676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381d688-2573-4366-b4a6-76b91c9ca42e None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.527958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381d688-2573-4366-b4a6-76b91c9ca42e None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.528665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381d688-2573-4366-b4a6-76b91c9ca42e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.530027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381d688-2573-4366-b4a6-76b91c9ca42e None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.536686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 647/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 16 00:15:20 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:15:22.614901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e74770-5d7d-4f46-a142-f7d702d14ca7 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.615433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e74770-5d7d-4f46-a142-f7d702d14ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.615433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e74770-5d7d-4f46-a142-f7d702d14ca7 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.616873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 655/1302] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:22.621890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c573-573f-4b71-9235-443ca0b45791 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.622299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c573-573f-4b71-9235-443ca0b45791 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.622456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c573-573f-4b71-9235-443ca0b45791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.639163 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-93f5c573-573f-4b71-9235-443ca0b45791 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:22.640371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-93f5c573-573f-4b71-9235-443ca0b45791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:22.704332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 648/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:22.726653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e74770-5d7d-4f46-a142-f7d702d14ca7 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:22.819614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:22.827209 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e74770-5d7d-4f46-a142-f7d702d14ca7 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:22.860110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4336e0-08ba-4b36-8d59-bbe5f23c189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:22.860894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4336e0-08ba-4b36-8d59-bbe5f23c189f None admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.861176 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4336e0-08ba-4b36-8d59-bbe5f23c189f None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.861454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4336e0-08ba-4b36-8d59-bbe5f23c189f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.862106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4336e0-08ba-4b36-8d59-bbe5f23c189f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:22.863458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4336e0-08ba-4b36-8d59-bbe5f23c189f None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application [None req-2d4336e0-08ba-4b36-8d59-bbe5f23c189f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:22.875346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:22.876603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: ERROR keystone.server.flask.application Jun 16 00:15:22.877668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 656/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 16 00:15:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:22.882370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c573-573f-4b71-9235-443ca0b45791 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:22.964466 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:22.986974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c573-573f-4b71-9235-443ca0b45791 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:23.022315 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d543e7f-34bc-4645-bbee-1a875f3ea1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:23.022986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d543e7f-34bc-4645-bbee-1a875f3ea1ef None admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.023274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d543e7f-34bc-4645-bbee-1a875f3ea1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.023555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d543e7f-34bc-4645-bbee-1a875f3ea1ef None admin] PATH_INFO: `/v3/services` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.024303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d543e7f-34bc-4645-bbee-1a875f3ea1ef None admin] RBAC: Adding query filter params (name=placement) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:23.024615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d543e7f-34bc-4645-bbee-1a875f3ea1ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:23.025992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d543e7f-34bc-4645-bbee-1a875f3ea1ef None admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:23.031181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 649/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jun 16 00:15:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:23.036808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4336e0-08ba-4b36-8d59-bbe5f23c189f None admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:23.132983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4336e0-08ba-4b36-8d59-bbe5f23c189f None admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:23.164934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc387a-17df-491a-ba05-60a319cb85ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:23.165591 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc387a-17df-491a-ba05-60a319cb85ec None admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:23.165949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc387a-17df-491a-ba05-60a319cb85ec None admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:23.166230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc387a-17df-491a-ba05-60a319cb85ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:23.166958 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc387a-17df-491a-ba05-60a319cb85ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:23.168350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc387a-17df-491a-ba05-60a319cb85ec None admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:23.186387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 657/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 16 00:15:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:33.028509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=30 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:33.181422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:25.119722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeaafe-69f6-412d-88c9-ebf60f50df70 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:25.120323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeaafe-69f6-412d-88c9-ebf60f50df70 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:25.121173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbeaafe-69f6-412d-88c9-ebf60f50df70 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:25.142486 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4201f-3f99-464d-a473-485daa7b80db None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:25.143680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4201f-3f99-464d-a473-485daa7b80db None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:25.144060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4201f-3f99-464d-a473-485daa7b80db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:25.147645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 650/1307] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:25 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:25.312302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-94b4201f-3f99-464d-a473-485daa7b80db None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:25.314991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-94b4201f-3f99-464d-a473-485daa7b80db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:25.511996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 658/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:16:25.547310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7506f-c581-48e6-abb8-18338c51131a None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:25.547993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7506f-c581-48e6-abb8-18338c51131a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:25.548659 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7506f-c581-48e6-abb8-18338c51131a None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:25.550632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 651/1309] 10.222.0.16 () {54 vars in 964 bytes} [Thu Jun 16 00:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:25.556470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31960ab2-37e4-49a3-89d7-ab884359a822 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:25.556772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31960ab2-37e4-49a3-89d7-ab884359a822 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:25.557061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31960ab2-37e4-49a3-89d7-ab884359a822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:25.641440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-31960ab2-37e4-49a3-89d7-ab884359a822 None None] MFA Rules not processed for user `9c142f4d77b54982abcd4b76edbcb4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:25.642762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-31960ab2-37e4-49a3-89d7-ab884359a822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:25.665722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:25.730577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 659/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Jun 16 00:16:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:16:25.739237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7506f-c581-48e6-abb8-18338c51131a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:25.741178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-12c7506f-c581-48e6-abb8-18338c51131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:25.865041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7506f-c581-48e6-abb8-18338c51131a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:25.942910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8256e-a996-4ccb-b4bc-f4989bb3accd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:25.943932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8256e-a996-4ccb-b4bc-f4989bb3accd service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:25.944388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8256e-a996-4ccb-b4bc-f4989bb3accd service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:25.944944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8256e-a996-4ccb-b4bc-f4989bb3accd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:25.946889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a7e8256e-a996-4ccb-b4bc-f4989bb3accd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:26.007856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:26.077739 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8256e-a996-4ccb-b4bc-f4989bb3accd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:26.079205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8256e-a996-4ccb-b4bc-f4989bb3accd service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:26.102739 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 652/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:16:28.565028 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998573b-5d2f-4b1c-9cc8-1b7844cf1814 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:28.565598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998573b-5d2f-4b1c-9cc8-1b7844cf1814 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:28.565598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998573b-5d2f-4b1c-9cc8-1b7844cf1814 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:28.566948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 660/1312] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:28.572510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c2cd-adcc-4732-803c-7a3867605a1f None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:28.572931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c2cd-adcc-4732-803c-7a3867605a1f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:28.573166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c2cd-adcc-4732-803c-7a3867605a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:28.643468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4d77c2cd-adcc-4732-803c-7a3867605a1f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:28.644698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4d77c2cd-adcc-4732-803c-7a3867605a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:28.743364 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 653/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:16:28.797168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1e477-fd86-4771-9f47-cd1c5652075c None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:28.797459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1e477-fd86-4771-9f47-cd1c5652075c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:28.797742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1e477-fd86-4771-9f47-cd1c5652075c None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:28.799129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 661/1314] 10.222.0.16 () {54 vars in 964 bytes} [Thu Jun 16 00:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:28.805588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb56554-2249-4d37-9a5e-e9b6532a75bf None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:28.805962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb56554-2249-4d37-9a5e-e9b6532a75bf None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:28.806307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb56554-2249-4d37-9a5e-e9b6532a75bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:28.817232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:28.888288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-6bb56554-2249-4d37-9a5e-e9b6532a75bf None None] MFA Rules not processed for user `9c142f4d77b54982abcd4b76edbcb4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:28.889493 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6bb56554-2249-4d37-9a5e-e9b6532a75bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:28.966559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 654/1315] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Jun 16 00:16:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:16:28.975725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1e477-fd86-4771-9f47-cd1c5652075c None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:28.977292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-93e1e477-fd86-4771-9f47-cd1c5652075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:29.085379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1e477-fd86-4771-9f47-cd1c5652075c None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:29.159432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:29.162070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3558cc-95ec-4000-998b-52d36578b362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:29.163001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3558cc-95ec-4000-998b-52d36578b362 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:29.163553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3558cc-95ec-4000-998b-52d36578b362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:29.164126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3558cc-95ec-4000-998b-52d36578b362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:29.165726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bf3558cc-95ec-4000-998b-52d36578b362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:29.273701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3558cc-95ec-4000-998b-52d36578b362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:29.275127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3558cc-95ec-4000-998b-52d36578b362 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:29.293090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 662/1316] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:16:31.919228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1bae-0397-46db-bb44-2b98ea6b0b7b None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:31.919770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1bae-0397-46db-bb44-2b98ea6b0b7b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:31.919770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1bae-0397-46db-bb44-2b98ea6b0b7b None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:31.921173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 655/1317] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:31.926283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa1570-3ed7-4aaa-a074-77bf0b01b0fe None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:31.926679 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa1570-3ed7-4aaa-a074-77bf0b01b0fe None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:31.926840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa1570-3ed7-4aaa-a074-77bf0b01b0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:31.989867 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6faa1570-3ed7-4aaa-a074-77bf0b01b0fe None None] MFA Rules not processed for user `addbdf471d3c4b1db21e1d0d4799f29b`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:31.991602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6faa1570-3ed7-4aaa-a074-77bf0b01b0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:32.044212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:32.089094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 663/1318] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:16:32.128183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1bae-0397-46db-bb44-2b98ea6b0b7b None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:32.129704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9fef1bae-0397-46db-bb44-2b98ea6b0b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:32.231013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1bae-0397-46db-bb44-2b98ea6b0b7b None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:32.233854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:32.301630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc76a98-9e8a-47d9-934a-2ac1f29291d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:32.302268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76a98-9e8a-47d9-934a-2ac1f29291d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:32.302550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76a98-9e8a-47d9-934a-2ac1f29291d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:32.302827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76a98-9e8a-47d9-934a-2ac1f29291d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:32.304543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8fc76a98-9e8a-47d9-934a-2ac1f29291d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:32.409578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc76a98-9e8a-47d9-934a-2ac1f29291d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:32.410992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc76a98-9e8a-47d9-934a-2ac1f29291d2 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:32.428241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 656/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:16:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:16:35.063939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38305b16-059f-4583-8a54-2fb5df25dae9 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:35.064485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38305b16-059f-4583-8a54-2fb5df25dae9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:35.064580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38305b16-059f-4583-8a54-2fb5df25dae9 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:35.065901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 664/1320] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:35.070952 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6aa38-22f9-49a8-a50c-3f41e2ae407d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:35.071331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6aa38-22f9-49a8-a50c-3f41e2ae407d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:35.071514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6aa38-22f9-49a8-a50c-3f41e2ae407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:35.110563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:35.138290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-05d6aa38-22f9-49a8-a50c-3f41e2ae407d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:35.139509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-05d6aa38-22f9-49a8-a50c-3f41e2ae407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:35.235170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 657/1321] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:16:35.274115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38305b16-059f-4583-8a54-2fb5df25dae9 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:35.275593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-38305b16-059f-4583-8a54-2fb5df25dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:35.376093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38305b16-059f-4583-8a54-2fb5df25dae9 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:35.449105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7c772-db03-4819-8d1c-a8e66f1b5e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:35.449742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7c772-db03-4819-8d1c-a8e66f1b5e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:35.450029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7c772-db03-4819-8d1c-a8e66f1b5e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:35.450307 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7c772-db03-4819-8d1c-a8e66f1b5e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:35.451953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a3e7c772-db03-4819-8d1c-a8e66f1b5e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:35.459210 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:35.558496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7c772-db03-4819-8d1c-a8e66f1b5e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:35.559851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7c772-db03-4819-8d1c-a8e66f1b5e74 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:35.577159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 665/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:16:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:16:38.367317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8c7a-e7fe-4e93-9ed0-62a323d846db None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.368016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8c7a-e7fe-4e93-9ed0-62a323d846db None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.368016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8c7a-e7fe-4e93-9ed0-62a323d846db None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.369307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 658/1323] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:38.375093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf144f-6683-4a2a-a5c8-4fab83fede4c None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.375676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf144f-6683-4a2a-a5c8-4fab83fede4c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.375676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf144f-6683-4a2a-a5c8-4fab83fede4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.445389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6cdf144f-6683-4a2a-a5c8-4fab83fede4c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:38.446625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6cdf144f-6683-4a2a-a5c8-4fab83fede4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:38.507240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:38.548883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 666/1324] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:16:38.584329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8c7a-e7fe-4e93-9ed0-62a323d846db None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:38.585847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0fec8c7a-e7fe-4e93-9ed0-62a323d846db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:38.687908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8c7a-e7fe-4e93-9ed0-62a323d846db None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:38.699824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:38.765668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbaf11-0ea5-4622-b51a-2637278e9b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:38.766236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbaf11-0ea5-4622-b51a-2637278e9b5a service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.766522 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbaf11-0ea5-4622-b51a-2637278e9b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.766801 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbaf11-0ea5-4622-b51a-2637278e9b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.768471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5bbbaf11-0ea5-4622-b51a-2637278e9b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:38.878819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbaf11-0ea5-4622-b51a-2637278e9b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:38.880296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbaf11-0ea5-4622-b51a-2637278e9b5a service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:38.898918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 659/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:16:41.069415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7cdf8-177e-482a-b830-956eeea4f490 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:41.069988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7cdf8-177e-482a-b830-956eeea4f490 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:41.069988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7cdf8-177e-482a-b830-956eeea4f490 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:41.071506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 667/1326] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:41.084761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa61a20-49b0-4c14-b479-c73fa973b130 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:41.085190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa61a20-49b0-4c14-b479-c73fa973b130 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:41.085332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa61a20-49b0-4c14-b479-c73fa973b130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:41.133455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:41.151937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0fa61a20-49b0-4c14-b479-c73fa973b130 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:41.153175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0fa61a20-49b0-4c14-b479-c73fa973b130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:41.250646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 660/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:16:41.286372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7cdf8-177e-482a-b830-956eeea4f490 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:41.288046 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a9b7cdf8-177e-482a-b830-956eeea4f490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:41.392841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7cdf8-177e-482a-b830-956eeea4f490 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:41.467976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ddc381-ebbd-4c9e-9e09-116432807a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:41.468663 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddc381-ebbd-4c9e-9e09-116432807a5d service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:41.468930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddc381-ebbd-4c9e-9e09-116432807a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:41.469202 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ddc381-ebbd-4c9e-9e09-116432807a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:41.470901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c5ddc381-ebbd-4c9e-9e09-116432807a5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:41.493337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:41.587836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddc381-ebbd-4c9e-9e09-116432807a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:41.589222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ddc381-ebbd-4c9e-9e09-116432807a5d service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:41.607478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 668/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:16:43.782975 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d5afb-08f0-4cbc-8dd5-09005b77e736 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.783503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d5afb-08f0-4cbc-8dd5-09005b77e736 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.783614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d5afb-08f0-4cbc-8dd5-09005b77e736 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.785014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 661/1329] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:43.790734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3865-bc80-4cff-a69c-d67f9efc687a None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.791155 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3865-bc80-4cff-a69c-d67f9efc687a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.791302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3865-bc80-4cff-a69c-d67f9efc687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.857528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-439d3865-bc80-4cff-a69c-d67f9efc687a None None] MFA Rules not processed for user `addbdf471d3c4b1db21e1d0d4799f29b`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:43.858763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-439d3865-bc80-4cff-a69c-d67f9efc687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:43.922822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:43.954225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 669/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:16:44.006906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d5afb-08f0-4cbc-8dd5-09005b77e736 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:44.008736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-381d5afb-08f0-4cbc-8dd5-09005b77e736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:44.126626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d5afb-08f0-4cbc-8dd5-09005b77e736 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:44.146895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:44.199575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18292c43-86a8-40eb-acd7-6a14afbe9a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:44.200250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18292c43-86a8-40eb-acd7-6a14afbe9a5f service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:44.200533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18292c43-86a8-40eb-acd7-6a14afbe9a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:44.200814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18292c43-86a8-40eb-acd7-6a14afbe9a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:44.202537 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-18292c43-86a8-40eb-acd7-6a14afbe9a5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:44.312532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18292c43-86a8-40eb-acd7-6a14afbe9a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:44.313900 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18292c43-86a8-40eb-acd7-6a14afbe9a5f service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:44.334464 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 662/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:16:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:16:46.685582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae63a-0f7e-4d4d-b11c-bd1aaf093030 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:46.686119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae63a-0f7e-4d4d-b11c-bd1aaf093030 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:46.686214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ae63a-0f7e-4d4d-b11c-bd1aaf093030 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:46.687516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 670/1332] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:46.692511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77900c7-9d2c-4634-b67a-c260340af9ec None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:46.693388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77900c7-9d2c-4634-b67a-c260340af9ec None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:46.693591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77900c7-9d2c-4634-b67a-c260340af9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:46.753438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:46.756962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e77900c7-9d2c-4634-b67a-c260340af9ec None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:46.758674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e77900c7-9d2c-4634-b67a-c260340af9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:46.853657 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 663/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:16:46.889418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ae63a-0f7e-4d4d-b11c-bd1aaf093030 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:46.890941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-555ae63a-0f7e-4d4d-b11c-bd1aaf093030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:46.991517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ae63a-0f7e-4d4d-b11c-bd1aaf093030 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:47.062369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43712460-e77c-4d80-947a-781cac1d2e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:47.063014 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712460-e77c-4d80-947a-781cac1d2e87 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:47.063296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712460-e77c-4d80-947a-781cac1d2e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:47.063572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712460-e77c-4d80-947a-781cac1d2e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:47.065221 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-43712460-e77c-4d80-947a-781cac1d2e87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:47.091719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:47.171083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43712460-e77c-4d80-947a-781cac1d2e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:47.172565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43712460-e77c-4d80-947a-781cac1d2e87 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:47.198132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 671/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:16:49.345442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8be35d-47d8-4483-984a-b088733c7c0d None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:49.345959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8be35d-47d8-4483-984a-b088733c7c0d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:49.346052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8be35d-47d8-4483-984a-b088733c7c0d None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:49.347430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 664/1335] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:49.353043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ba5f2-9b7d-491a-ac6d-3b40556a3387 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:49.353436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ba5f2-9b7d-491a-ac6d-3b40556a3387 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:49.353617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ba5f2-9b7d-491a-ac6d-3b40556a3387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:49.417241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4a9ba5f2-9b7d-491a-ac6d-3b40556a3387 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:49.418444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4a9ba5f2-9b7d-491a-ac6d-3b40556a3387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:49.489975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:49.512385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 672/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:16:49.552351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8be35d-47d8-4483-984a-b088733c7c0d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:49.553879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ba8be35d-47d8-4483-984a-b088733c7c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:49.654451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8be35d-47d8-4483-984a-b088733c7c0d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:49.681297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:49.726101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc14a5-8763-43b9-8898-7aa996991233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:49.726963 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc14a5-8763-43b9-8898-7aa996991233 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:49.727241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc14a5-8763-43b9-8898-7aa996991233 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:49.727515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc14a5-8763-43b9-8898-7aa996991233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:49.729150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2ecc14a5-8763-43b9-8898-7aa996991233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:49.834372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc14a5-8763-43b9-8898-7aa996991233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:49.835800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc14a5-8763-43b9-8898-7aa996991233 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:49.854083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 665/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:16:52.274086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b877af7-d55a-4140-9439-2f3cdeb236c3 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:52.274608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b877af7-d55a-4140-9439-2f3cdeb236c3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:52.274608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b877af7-d55a-4140-9439-2f3cdeb236c3 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:52.276098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 673/1338] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:52.281439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c774-c98f-49c7-bda8-900921635b93 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:52.281889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c774-c98f-49c7-bda8-900921635b93 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:52.282070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98c774-c98f-49c7-bda8-900921635b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:52.350503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ca98c774-c98f-49c7-bda8-900921635b93 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:52.351725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ca98c774-c98f-49c7-bda8-900921635b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:52.360005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:52.449829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 666/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:16:52.486462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b877af7-d55a-4140-9439-2f3cdeb236c3 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:52.488013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-2b877af7-d55a-4140-9439-2f3cdeb236c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:52.589040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b877af7-d55a-4140-9439-2f3cdeb236c3 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:52.658704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03541865-145f-4146-af3a-137fef8b4b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:52.659346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541865-145f-4146-af3a-137fef8b4b65 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:52.659631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541865-145f-4146-af3a-137fef8b4b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:52.659910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541865-145f-4146-af3a-137fef8b4b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:52.662091 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-03541865-145f-4146-af3a-137fef8b4b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:52.696507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:52.768560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03541865-145f-4146-af3a-137fef8b4b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:52.769989 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03541865-145f-4146-af3a-137fef8b4b65 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:52.788043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 674/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:16:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:16:56.806740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093d29-9561-4a5c-974e-922fa51fdac6 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:56.807285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093d29-9561-4a5c-974e-922fa51fdac6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:56.807285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093d29-9561-4a5c-974e-922fa51fdac6 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:56.808655 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 667/1341] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:56.813883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249610-5c7a-43c1-a88c-c7dfbefa5992 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:56.814338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249610-5c7a-43c1-a88c-c7dfbefa5992 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:56.814620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249610-5c7a-43c1-a88c-c7dfbefa5992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:56.888125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-d7249610-5c7a-43c1-a88c-c7dfbefa5992 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:56.889336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d7249610-5c7a-43c1-a88c-c7dfbefa5992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:56.984769 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:56.998194 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 675/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:16:57.037722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093d29-9561-4a5c-974e-922fa51fdac6 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:57.040206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-01093d29-9561-4a5c-974e-922fa51fdac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:57.138362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093d29-9561-4a5c-974e-922fa51fdac6 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:57.141993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c2eeb-6d20-45cd-8d60-8c238ab3eb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:57.142646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c2eeb-6d20-45cd-8d60-8c238ab3eb57 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:57.142934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c2eeb-6d20-45cd-8d60-8c238ab3eb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:57.143218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c2eeb-6d20-45cd-8d60-8c238ab3eb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:57.152956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c2eeb-6d20-45cd-8d60-8c238ab3eb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:57.154420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c2eeb-6d20-45cd-8d60-8c238ab3eb57 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:57.163720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 668/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:16:59.930099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17319ad-b650-4d32-b3f7-241adac5ff78 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:59.930639 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17319ad-b650-4d32-b3f7-241adac5ff78 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:59.930639 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17319ad-b650-4d32-b3f7-241adac5ff78 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:59.932348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 676/1344] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:59.937427 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7a55a-7c2d-4e7a-a1bf-ce4a22419aa5 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:59.937822 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7a55a-7c2d-4e7a-a1bf-ce4a22419aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:59.938041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7a55a-7c2d-4e7a-a1bf-ce4a22419aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:59.968311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-f7d7a55a-7c2d-4e7a-a1bf-ce4a22419aa5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:59.969570 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f7d7a55a-7c2d-4e7a-a1bf-ce4a22419aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:00.002470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:00.060671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 669/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:00.098163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17319ad-b650-4d32-b3f7-241adac5ff78 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:00.110055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17319ad-b650-4d32-b3f7-241adac5ff78 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:00.113290 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b653acf-933e-4aa0-8ac0-e546ccf0b4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:00.113945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b653acf-933e-4aa0-8ac0-e546ccf0b4be service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:00.114823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b653acf-933e-4aa0-8ac0-e546ccf0b4be service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:00.115173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b653acf-933e-4aa0-8ac0-e546ccf0b4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:00.124786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b653acf-933e-4aa0-8ac0-e546ccf0b4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:00.126228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b653acf-933e-4aa0-8ac0-e546ccf0b4be service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:00.136338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 677/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:04.183769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893051-aca5-46e1-afd2-df216624e6e8 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:04.184294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893051-aca5-46e1-afd2-df216624e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:04.184391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893051-aca5-46e1-afd2-df216624e6e8 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:04.185752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 670/1347] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:04.191095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eb48c-5e78-40c1-9a39-202718fabb11 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:04.191544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eb48c-5e78-40c1-9a39-202718fabb11 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:04.191658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eb48c-5e78-40c1-9a39-202718fabb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:04.210066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a37eb48c-5e78-40c1-9a39-202718fabb11 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:04.211544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a37eb48c-5e78-40c1-9a39-202718fabb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:04.219445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 678/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:04.257862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba893051-aca5-46e1-afd2-df216624e6e8 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:04.260680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ba893051-aca5-46e1-afd2-df216624e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:04.275525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba893051-aca5-46e1-afd2-df216624e6e8 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:04.279008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8a7fc-3372-4875-8bba-eeaddeba69c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:04.279721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a7fc-3372-4875-8bba-eeaddeba69c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:04.280039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a7fc-3372-4875-8bba-eeaddeba69c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:04.280323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a7fc-3372-4875-8bba-eeaddeba69c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:04.289410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8a7fc-3372-4875-8bba-eeaddeba69c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:04.290853 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8a7fc-3372-4875-8bba-eeaddeba69c3 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:04.302077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 671/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:09.481708 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f7b9-1b6c-4744-bb27-2fe26149eb08 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:09.482272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f7b9-1b6c-4744-bb27-2fe26149eb08 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:09.482272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f7b9-1b6c-4744-bb27-2fe26149eb08 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:09.483637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 679/1350] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:09.489858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b01ba-9787-4b62-90ca-8de58874ccf0 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:09.490755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b01ba-9787-4b62-90ca-8de58874ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:09.491258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b01ba-9787-4b62-90ca-8de58874ccf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:09.563910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-340b01ba-9787-4b62-90ca-8de58874ccf0 None None] MFA Rules not processed for user `7dde39c6d85446a681dea24573f0d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:09.565617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-340b01ba-9787-4b62-90ca-8de58874ccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:09.668138 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 672/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:17:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:13.829144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ffacf-4418-411a-afa8-dbf2410e2521 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:13.829688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ffacf-4418-411a-afa8-dbf2410e2521 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:13.829688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ffacf-4418-411a-afa8-dbf2410e2521 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:13.831170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 680/1352] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:13.837144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb61e99-3e9a-49ea-8736-daf963430fa4 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:13.837568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb61e99-3e9a-49ea-8736-daf963430fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:13.837792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb61e99-3e9a-49ea-8736-daf963430fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:13.856944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4bb61e99-3e9a-49ea-8736-daf963430fa4 None None] MFA Rules not processed for user `7dde39c6d85446a681dea24573f0d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:13.858287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4bb61e99-3e9a-49ea-8736-daf963430fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:13.872010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 673/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:17:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:14.204422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=13 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:15.341854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956fe34-9233-410a-ab80-bb1dc89086bb None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:15.342496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956fe34-9233-410a-ab80-bb1dc89086bb None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:15.342496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956fe34-9233-410a-ab80-bb1dc89086bb None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:15.343829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 681/1354] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:17:15.348881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037db816-7c49-4f68-81a3-6b650fb771a3 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:15.349301 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037db816-7c49-4f68-81a3-6b650fb771a3 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:15.349467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037db816-7c49-4f68-81a3-6b650fb771a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:15.368217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-037db816-7c49-4f68-81a3-6b650fb771a3 None None] MFA Rules not processed for user `7dde39c6d85446a681dea24573f0d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:15.369473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-037db816-7c49-4f68-81a3-6b650fb771a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:15.377943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 674/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:17:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:19.219083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4d08b-41fa-4838-a96a-1edc6f0c7215 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:19.219618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4d08b-41fa-4838-a96a-1edc6f0c7215 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:19.219618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4d08b-41fa-4838-a96a-1edc6f0c7215 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:19.221033 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 682/1356] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:19.226856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2e15-127d-4f6b-8048-ec7c87bfea63 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:19.227278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2e15-127d-4f6b-8048-ec7c87bfea63 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:19.227411 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2e15-127d-4f6b-8048-ec7c87bfea63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:19.247057 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d75f2e15-127d-4f6b-8048-ec7c87bfea63 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:19.248188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d75f2e15-127d-4f6b-8048-ec7c87bfea63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:19.255925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 675/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:19.309122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226334a2-bb94-43ab-859f-a69600737e64 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:19.309697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226334a2-bb94-43ab-859f-a69600737e64 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:19.310272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226334a2-bb94-43ab-859f-a69600737e64 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:19.311866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 683/1358] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jun 16 00:17:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:19.319830 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f81ab7-0070-44f3-bba2-694ac27f5ad0 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:19.320426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f81ab7-0070-44f3-bba2-694ac27f5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:19.320883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f81ab7-0070-44f3-bba2-694ac27f5ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:19.370489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:19.379590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-b2f81ab7-0070-44f3-bba2-694ac27f5ad0 None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:19.380824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b2f81ab7-0070-44f3-bba2-694ac27f5ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:19.466812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 676/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jun 16 00:17:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:17:19.475543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226334a2-bb94-43ab-859f-a69600737e64 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:19.490199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226334a2-bb94-43ab-859f-a69600737e64 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:19.496127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886bad0-4573-48c0-a1d2-8595c277bd46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:19.496772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886bad0-4573-48c0-a1d2-8595c277bd46 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:19.497132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886bad0-4573-48c0-a1d2-8595c277bd46 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:19.497358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886bad0-4573-48c0-a1d2-8595c277bd46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:19.506622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886bad0-4573-48c0-a1d2-8595c277bd46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:19.508425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886bad0-4573-48c0-a1d2-8595c277bd46 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:19.519075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 684/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:17:21.862766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7587f-6007-4f32-9c1d-146bf75079ea None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:21.863812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7587f-6007-4f32-9c1d-146bf75079ea None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:21.863940 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7587f-6007-4f32-9c1d-146bf75079ea None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:21.865395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 677/1361] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:21.874001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dee386-0cd3-4287-9643-dbe099d9390b None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:21.874859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dee386-0cd3-4287-9643-dbe099d9390b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:21.875295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dee386-0cd3-4287-9643-dbe099d9390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:21.896505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-98dee386-0cd3-4287-9643-dbe099d9390b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:21.897772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-98dee386-0cd3-4287-9643-dbe099d9390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:21.907850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 685/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:21.952671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7587f-6007-4f32-9c1d-146bf75079ea None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:21.967291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7587f-6007-4f32-9c1d-146bf75079ea None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:21.972778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e470c4-74e2-4a81-97a8-8fa81161b6bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:21.973414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e470c4-74e2-4a81-97a8-8fa81161b6bd service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:21.973696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e470c4-74e2-4a81-97a8-8fa81161b6bd service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:21.973971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e470c4-74e2-4a81-97a8-8fa81161b6bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:21.982539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e470c4-74e2-4a81-97a8-8fa81161b6bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:21.984098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e470c4-74e2-4a81-97a8-8fa81161b6bd service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:21.995665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 678/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:24.467625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d7ae4-4531-4970-83b9-c6ef33182082 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:24.468159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d7ae4-4531-4970-83b9-c6ef33182082 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:24.468255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d7ae4-4531-4970-83b9-c6ef33182082 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:24.469637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 686/1364] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:24.475406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856a07-96f8-4c76-8d49-e9ab6d970404 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:24.475843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856a07-96f8-4c76-8d49-e9ab6d970404 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:24.475988 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856a07-96f8-4c76-8d49-e9ab6d970404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:24.494125 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2d856a07-96f8-4c76-8d49-e9ab6d970404 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:24.495321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2d856a07-96f8-4c76-8d49-e9ab6d970404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:24.503097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 679/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:24.548828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb27e4-5f5a-4f38-a5a8-4e431b4e381e None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:24.549125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb27e4-5f5a-4f38-a5a8-4e431b4e381e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:24.549413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb27e4-5f5a-4f38-a5a8-4e431b4e381e None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:24.551532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 687/1366] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jun 16 00:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:24.557018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c57c36-38f3-4c89-b709-799297dab5d6 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:24.557310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c57c36-38f3-4c89-b709-799297dab5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:24.557590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c57c36-38f3-4c89-b709-799297dab5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:24.579141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-72c57c36-38f3-4c89-b709-799297dab5d6 None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:24.580375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-72c57c36-38f3-4c89-b709-799297dab5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:24.589953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 680/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jun 16 00:17:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:17:24.598527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb27e4-5f5a-4f38-a5a8-4e431b4e381e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:24.612654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb27e4-5f5a-4f38-a5a8-4e431b4e381e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:24.618779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9fb02-e38d-4907-b0b1-3f60ebc8d862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:24.619668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9fb02-e38d-4907-b0b1-3f60ebc8d862 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:24.620379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9fb02-e38d-4907-b0b1-3f60ebc8d862 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:24.620825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9fb02-e38d-4907-b0b1-3f60ebc8d862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:24.629165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9fb02-e38d-4907-b0b1-3f60ebc8d862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:24.630815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9fb02-e38d-4907-b0b1-3f60ebc8d862 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:24.640889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 688/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:26.828574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0a9ab-3795-4be0-b00b-a5d28e062313 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:26.829115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0a9ab-3795-4be0-b00b-a5d28e062313 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:26.829115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0a9ab-3795-4be0-b00b-a5d28e062313 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:26.830507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 681/1369] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:26.836009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ebf44-4875-4602-95d8-28f54b45932e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:26.836408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ebf44-4875-4602-95d8-28f54b45932e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:26.836583 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ebf44-4875-4602-95d8-28f54b45932e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:26.855558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a71ebf44-4875-4602-95d8-28f54b45932e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:26.856769 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a71ebf44-4875-4602-95d8-28f54b45932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:26.866035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 689/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:26.907846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0a9ab-3795-4be0-b00b-a5d28e062313 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:26.925961 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0a9ab-3795-4be0-b00b-a5d28e062313 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:26.931826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4270f-97bf-4b42-945a-3316cd8aa9c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:26.932709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4270f-97bf-4b42-945a-3316cd8aa9c6 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:26.933103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4270f-97bf-4b42-945a-3316cd8aa9c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:26.933389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4270f-97bf-4b42-945a-3316cd8aa9c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:26.942793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4270f-97bf-4b42-945a-3316cd8aa9c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:26.944817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4270f-97bf-4b42-945a-3316cd8aa9c6 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:26.958248 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 682/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:27.324622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4bed5-6b71-480c-ab97-577915cec5e1 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:27.324905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4bed5-6b71-480c-ab97-577915cec5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:27.325408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4bed5-6b71-480c-ab97-577915cec5e1 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:27.327081 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 690/1372] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:27.332684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e08bc2-02cf-49c7-b3b4-309757ba90ff None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:27.333084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e08bc2-02cf-49c7-b3b4-309757ba90ff None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:27.333434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e08bc2-02cf-49c7-b3b4-309757ba90ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:27.352137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-42e08bc2-02cf-49c7-b3b4-309757ba90ff None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:27.353320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-42e08bc2-02cf-49c7-b3b4-309757ba90ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:27.364006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 683/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:17:27.666829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d199692-6055-4adc-81db-b223c94f8ea3 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:27.666829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d199692-6055-4adc-81db-b223c94f8ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:27.666829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d199692-6055-4adc-81db-b223c94f8ea3 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:27.669396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 691/1374] 10.222.0.16 () {54 vars in 963 bytes} [Thu Jun 16 00:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:27.673182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1623c99-80fc-4ede-9dc1-dba0fe5ba051 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:27.673486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1623c99-80fc-4ede-9dc1-dba0fe5ba051 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:27.673776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1623c99-80fc-4ede-9dc1-dba0fe5ba051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:27.725844 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e1623c99-80fc-4ede-9dc1-dba0fe5ba051 None None] MFA Rules not processed for user `b0e658f3947f41a9a3e09ea327b5d8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:27.727061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e1623c99-80fc-4ede-9dc1-dba0fe5ba051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:27.796354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 684/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Jun 16 00:17:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:27.801693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d199692-6055-4adc-81db-b223c94f8ea3 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:27.813840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d199692-6055-4adc-81db-b223c94f8ea3 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:27.819319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae9dd0-f54e-4d9f-aa8f-428ce2e6c451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:27.820610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae9dd0-f54e-4d9f-aa8f-428ce2e6c451 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:27.820730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae9dd0-f54e-4d9f-aa8f-428ce2e6c451 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:27.820967 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae9dd0-f54e-4d9f-aa8f-428ce2e6c451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:27.834313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae9dd0-f54e-4d9f-aa8f-428ce2e6c451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:27.837193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae9dd0-f54e-4d9f-aa8f-428ce2e6c451 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:27.850503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 692/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:29.157120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2b12c-9ecf-4507-bfab-3c6a49761d7c None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:29.157682 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2b12c-9ecf-4507-bfab-3c6a49761d7c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:29.157777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2b12c-9ecf-4507-bfab-3c6a49761d7c None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:29.159161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 685/1377] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:29.164478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7dad5-de56-4261-a50d-b432a134f1c3 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:29.164912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7dad5-de56-4261-a50d-b432a134f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:29.165162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7dad5-de56-4261-a50d-b432a134f1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:29.182399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-d7f7dad5-de56-4261-a50d-b432a134f1c3 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:29.183603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d7f7dad5-de56-4261-a50d-b432a134f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:29.191868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 693/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:29.235369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2b12c-9ecf-4507-bfab-3c6a49761d7c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:29.249535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2b12c-9ecf-4507-bfab-3c6a49761d7c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:29.255538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf85a22-a808-4922-90cd-f9cdc09b6006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:29.256316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf85a22-a808-4922-90cd-f9cdc09b6006 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:29.256662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf85a22-a808-4922-90cd-f9cdc09b6006 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:29.257007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf85a22-a808-4922-90cd-f9cdc09b6006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:29.265238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf85a22-a808-4922-90cd-f9cdc09b6006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:29.266897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf85a22-a808-4922-90cd-f9cdc09b6006 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:29.271315 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:29.278596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 686/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:31.447462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8601b6-74e4-4bf8-afba-46ad5430d3b4 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:31.448058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8601b6-74e4-4bf8-afba-46ad5430d3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:31.448058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8601b6-74e4-4bf8-afba-46ad5430d3b4 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:31.449424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 694/1380] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:31.454660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fa516-e174-429e-8d21-6828f4906147 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:31.455084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fa516-e174-429e-8d21-6828f4906147 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:31.455213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fa516-e174-429e-8d21-6828f4906147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:31.473742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-139fa516-e174-429e-8d21-6828f4906147 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:31.474919 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-139fa516-e174-429e-8d21-6828f4906147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:31.482691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 687/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:31.525845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8601b6-74e4-4bf8-afba-46ad5430d3b4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:31.540442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8601b6-74e4-4bf8-afba-46ad5430d3b4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:31.545841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48f2d-e258-45f8-b031-75b178b0464d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:31.546483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48f2d-e258-45f8-b031-75b178b0464d service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:31.546771 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48f2d-e258-45f8-b031-75b178b0464d service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:31.547053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48f2d-e258-45f8-b031-75b178b0464d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:31.556280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a48f2d-e258-45f8-b031-75b178b0464d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:31.558209 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a48f2d-e258-45f8-b031-75b178b0464d service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:31.569238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 695/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:33.732695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda60b99-82e4-4618-b2fc-5bc582201f67 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:33.733243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda60b99-82e4-4618-b2fc-5bc582201f67 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:33.733243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda60b99-82e4-4618-b2fc-5bc582201f67 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:33.734610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 688/1383] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:33.740756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbb18a-7025-4876-b6b4-e90aa036fe5c None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:33.741249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbb18a-7025-4876-b6b4-e90aa036fe5c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:33.741423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbb18a-7025-4876-b6b4-e90aa036fe5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:33.763501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-94dbb18a-7025-4876-b6b4-e90aa036fe5c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:33.764789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-94dbb18a-7025-4876-b6b4-e90aa036fe5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:33.773628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 696/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:33.814797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda60b99-82e4-4618-b2fc-5bc582201f67 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:33.831766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda60b99-82e4-4618-b2fc-5bc582201f67 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:33.837407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfb93b-ea24-40b1-8ca4-dc2fdca01ed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:33.838048 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfb93b-ea24-40b1-8ca4-dc2fdca01ed6 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:33.838327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfb93b-ea24-40b1-8ca4-dc2fdca01ed6 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:33.838603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfb93b-ea24-40b1-8ca4-dc2fdca01ed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:33.847851 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cfb93b-ea24-40b1-8ca4-dc2fdca01ed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:33.849462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cfb93b-ea24-40b1-8ca4-dc2fdca01ed6 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:33.859459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 689/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:35.984998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0f8a-e692-4308-9eef-f87f2447b591 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:35.985564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0f8a-e692-4308-9eef-f87f2447b591 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:35.985564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0f8a-e692-4308-9eef-f87f2447b591 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:35.986929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 697/1386] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:35.993886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428862e-bd27-4f99-8fcd-4caefa9f230c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:35.994316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428862e-bd27-4f99-8fcd-4caefa9f230c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:35.994441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428862e-bd27-4f99-8fcd-4caefa9f230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:36.011779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2428862e-bd27-4f99-8fcd-4caefa9f230c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:36.013004 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2428862e-bd27-4f99-8fcd-4caefa9f230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:36.022198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 690/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:17:36.076229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde0f8a-e692-4308-9eef-f87f2447b591 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:36.091291 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde0f8a-e692-4308-9eef-f87f2447b591 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:36.097365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9b64b-579a-4fab-83aa-75dbe662e2d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:36.098010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9b64b-579a-4fab-83aa-75dbe662e2d7 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:36.098291 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9b64b-579a-4fab-83aa-75dbe662e2d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:36.098566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9b64b-579a-4fab-83aa-75dbe662e2d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:36.106766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9b64b-579a-4fab-83aa-75dbe662e2d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:36.108392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9b64b-579a-4fab-83aa-75dbe662e2d7 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:36.118129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 698/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:38.753675 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b49ee-5186-4551-9e9e-c851252a0d86 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:38.754205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b49ee-5186-4551-9e9e-c851252a0d86 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:38.754297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b49ee-5186-4551-9e9e-c851252a0d86 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:38.755602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 691/1389] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:38.760731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee9c6-5ffd-446f-beb2-2e5d11c7116b None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:38.761276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee9c6-5ffd-446f-beb2-2e5d11c7116b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:38.761369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee9c6-5ffd-446f-beb2-2e5d11c7116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:38.778903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-68eee9c6-5ffd-446f-beb2-2e5d11c7116b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:38.780262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-68eee9c6-5ffd-446f-beb2-2e5d11c7116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:38.789545 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 699/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:38.832882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b49ee-5186-4551-9e9e-c851252a0d86 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:38.848565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b49ee-5186-4551-9e9e-c851252a0d86 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:38.854091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158d231-2432-4a99-853e-c348fe83ac14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:38.854756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158d231-2432-4a99-853e-c348fe83ac14 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:38.855058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158d231-2432-4a99-853e-c348fe83ac14 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:38.855357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158d231-2432-4a99-853e-c348fe83ac14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:38.864588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158d231-2432-4a99-853e-c348fe83ac14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:38.866252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158d231-2432-4a99-853e-c348fe83ac14 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:38.876085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 692/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:41.032332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aba263-1902-4b88-bdba-a71d830462d9 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:41.032964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aba263-1902-4b88-bdba-a71d830462d9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:41.032964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aba263-1902-4b88-bdba-a71d830462d9 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:41.034804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 700/1392] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:41.040319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949d6f-929a-4d10-bb53-49471dc41551 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:41.040878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949d6f-929a-4d10-bb53-49471dc41551 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:41.040878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949d6f-929a-4d10-bb53-49471dc41551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:41.060488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-8d949d6f-929a-4d10-bb53-49471dc41551 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:41.061693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8d949d6f-929a-4d10-bb53-49471dc41551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:41.069800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 693/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:41.114635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aba263-1902-4b88-bdba-a71d830462d9 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:41.129207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aba263-1902-4b88-bdba-a71d830462d9 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:41.134706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a0110-ae4f-4062-a282-7ba34ac48bc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:41.135351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a0110-ae4f-4062-a282-7ba34ac48bc4 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:41.135632 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a0110-ae4f-4062-a282-7ba34ac48bc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:41.135913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a0110-ae4f-4062-a282-7ba34ac48bc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:41.144333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a0110-ae4f-4062-a282-7ba34ac48bc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:41.145916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a0110-ae4f-4062-a282-7ba34ac48bc4 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:41.155221 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 701/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:43.124549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c93dae-1c5c-4d3c-8595-d94c1db5bbdb None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:43.125107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c93dae-1c5c-4d3c-8595-d94c1db5bbdb None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:43.125107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c93dae-1c5c-4d3c-8595-d94c1db5bbdb None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:43.126638 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 694/1395] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:43.132120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114d4d-8221-46eb-a6a7-e3206433d342 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:43.132524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114d4d-8221-46eb-a6a7-e3206433d342 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:43.132699 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114d4d-8221-46eb-a6a7-e3206433d342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:43.150106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-d1114d4d-8221-46eb-a6a7-e3206433d342 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:43.151284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d1114d4d-8221-46eb-a6a7-e3206433d342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:43.159889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 702/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:43.215827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd9621-cb9d-45c5-9e80-ebc650560212 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:43.216157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd9621-cb9d-45c5-9e80-ebc650560212 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:43.216467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd9621-cb9d-45c5-9e80-ebc650560212 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:43.218084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 695/1397] 10.222.0.16 () {54 vars in 962 bytes} [Thu Jun 16 00:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:43.224567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc563dc-e010-4a62-9ace-43a9c63bfdaf None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:43.224950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc563dc-e010-4a62-9ace-43a9c63bfdaf None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:43.225300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc563dc-e010-4a62-9ace-43a9c63bfdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:43.276142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-bfc563dc-e010-4a62-9ace-43a9c63bfdaf None None] MFA Rules not processed for user `7ee61aece9c64e74806248e4ac49cd47`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:43.277253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bfc563dc-e010-4a62-9ace-43a9c63bfdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:43.289376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3f9b-321c-4fc7-9ba2-48c8d3456a21 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:43.289745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3f9b-321c-4fc7-9ba2-48c8d3456a21 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:43.290098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3f9b-321c-4fc7-9ba2-48c8d3456a21 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:43.291603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 696/1398] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:17:43.296815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7b6a1-a42a-4fa8-abd3-e55d1b0074de None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:43.297106 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7b6a1-a42a-4fa8-abd3-e55d1b0074de None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:43.297789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7b6a1-a42a-4fa8-abd3-e55d1b0074de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:43.316882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2ee7b6a1-a42a-4fa8-abd3-e55d1b0074de None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:43.318071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2ee7b6a1-a42a-4fa8-abd3-e55d1b0074de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:43.325995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 697/1399] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:17:43.337465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 703/1400] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Jun 16 00:17:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:43.345196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7b6a1-a42a-4fa8-abd3-e55d1b0074de None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:43.355125 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7b6a1-a42a-4fa8-abd3-e55d1b0074de None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:43.359482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc977f-8f0f-408b-b965-32d589dad005 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee61aece9c64e74806248e4ac49cd47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:43.360164 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc977f-8f0f-408b-b965-32d589dad005 service glance] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:43.360450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc977f-8f0f-408b-b965-32d589dad005 service glance] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:43.360729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc977f-8f0f-408b-b965-32d589dad005 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:43.369997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc563dc-e010-4a62-9ace-43a9c63bfdaf None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:43.370654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc977f-8f0f-408b-b965-32d589dad005 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:43.372129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc977f-8f0f-408b-b965-32d589dad005 service glance] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:43.381631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 698/1401] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:43.382977 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc563dc-e010-4a62-9ace-43a9c63bfdaf None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:43.388473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33354aa5-32f2-4422-ac02-c432b9784410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:43.389150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354aa5-32f2-4422-ac02-c432b9784410 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:43.389439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354aa5-32f2-4422-ac02-c432b9784410 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:43.389719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354aa5-32f2-4422-ac02-c432b9784410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:43.398194 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33354aa5-32f2-4422-ac02-c432b9784410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:43.399815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33354aa5-32f2-4422-ac02-c432b9784410 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:43.409941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 704/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:17:44.114901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bd831-68e2-4899-92c5-f5de68be10fc None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:44.115194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bd831-68e2-4899-92c5-f5de68be10fc None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:44.115498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bd831-68e2-4899-92c5-f5de68be10fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:44.164277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4e3bd831-68e2-4899-92c5-f5de68be10fc None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:44.165482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4e3bd831-68e2-4899-92c5-f5de68be10fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:44.229028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 699/1403] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:17:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:44.273356 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79346465-ea5a-4018-9b30-15f4cd47b7fd None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:44.273815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79346465-ea5a-4018-9b30-15f4cd47b7fd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:44.274049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79346465-ea5a-4018-9b30-15f4cd47b7fd None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:44.275507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 705/1404] 10.222.0.16 () {54 vars in 942 bytes} [Thu Jun 16 00:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:44.281596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f117a7-faea-4cb2-a81b-3176c4e4e41b None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:44.281896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f117a7-faea-4cb2-a81b-3176c4e4e41b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:44.282178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f117a7-faea-4cb2-a81b-3176c4e4e41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:44.330074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-43f117a7-faea-4cb2-a81b-3176c4e4e41b None None] MFA Rules not processed for user `88d67d41124c4deda1c5ecdab82d3055`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:44.331370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-43f117a7-faea-4cb2-a81b-3176c4e4e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:44.364452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:44.403548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 700/1405] 10.222.0.16 () {58 vars in 1039 bytes} [Thu Jun 16 00:17:44 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:17:44.413612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79346465-ea5a-4018-9b30-15f4cd47b7fd None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:44.420913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:44.427750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79346465-ea5a-4018-9b30-15f4cd47b7fd None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:44.432802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f4d54-83d1-4aca-8ea6-4377220eafe0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:44.433501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4d54-83d1-4aca-8ea6-4377220eafe0 service swift] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:44.433795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4d54-83d1-4aca-8ea6-4377220eafe0 service swift] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:44.434078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4d54-83d1-4aca-8ea6-4377220eafe0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:44.442053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f4d54-83d1-4aca-8ea6-4377220eafe0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:44.443629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f4d54-83d1-4aca-8ea6-4377220eafe0 service swift] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:44.451544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 706/1406] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:17:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:17:45.559235 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff76d6-3c07-4f4e-9e02-b8021331e6e6 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:45.559774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff76d6-3c07-4f4e-9e02-b8021331e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:45.559774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff76d6-3c07-4f4e-9e02-b8021331e6e6 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:45.561169 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 701/1407] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:45.567776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1af83-1e72-41cd-9f6f-9c7d25a18fd5 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:45.568668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1af83-1e72-41cd-9f6f-9c7d25a18fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:45.569134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1af83-1e72-41cd-9f6f-9c7d25a18fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:45.588341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b6b1af83-1e72-41cd-9f6f-9c7d25a18fd5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:45.589791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b6b1af83-1e72-41cd-9f6f-9c7d25a18fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:45.597732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 707/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:17:45.641326 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff76d6-3c07-4f4e-9e02-b8021331e6e6 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:45.656523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff76d6-3c07-4f4e-9e02-b8021331e6e6 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:45.662045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05704820-e23f-4f34-8d5e-f251916604e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:45.662687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05704820-e23f-4f34-8d5e-f251916604e9 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:45.662994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05704820-e23f-4f34-8d5e-f251916604e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:45.663269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05704820-e23f-4f34-8d5e-f251916604e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:45.673691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05704820-e23f-4f34-8d5e-f251916604e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:45.676609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05704820-e23f-4f34-8d5e-f251916604e9 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:45.687000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 702/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:17:55.582330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=8 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:55.684687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=21 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:06.802858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab06de-6af8-4ec7-9d87-515f1174704f None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:06.803436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab06de-6af8-4ec7-9d87-515f1174704f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:06.803551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab06de-6af8-4ec7-9d87-515f1174704f None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:06.805090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 708/1410] 10.222.0.16 () {54 vars in 918 bytes} [Thu Jun 16 00:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:06.810170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d85ba-d2e0-4f2d-ab89-ebe0af496ec0 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:06.810552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d85ba-d2e0-4f2d-ab89-ebe0af496ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:06.810756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d85ba-d2e0-4f2d-ab89-ebe0af496ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:06.828450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7f3d85ba-d2e0-4f2d-ab89-ebe0af496ec0 None None] MFA Rules not processed for user `7dde39c6d85446a681dea24573f0d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:06.830143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7f3d85ba-d2e0-4f2d-ab89-ebe0af496ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:06.838704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 703/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Jun 16 00:18:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:06.852983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd44650-e256-41e1-93b6-a0713d8629db None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:06.853281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd44650-e256-41e1-93b6-a0713d8629db None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:06.853568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd44650-e256-41e1-93b6-a0713d8629db None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:06.855087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 709/1412] 10.222.0.16 () {54 vars in 918 bytes} [Thu Jun 16 00:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:06.859608 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20d96a-e09a-47c0-814b-01cb4d5a8d1c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:06.859897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20d96a-e09a-47c0-814b-01cb4d5a8d1c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:06.860218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20d96a-e09a-47c0-814b-01cb4d5a8d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:06.877283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0f20d96a-e09a-47c0-814b-01cb4d5a8d1c None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:06.878449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0f20d96a-e09a-47c0-814b-01cb4d5a8d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:06.887589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 704/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Jun 16 00:18:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:09.437736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2832ca-46de-43d1-a52f-e547dcaab9fd None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:09.438269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2832ca-46de-43d1-a52f-e547dcaab9fd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:09.438269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2832ca-46de-43d1-a52f-e547dcaab9fd None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:09.440191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:18:09.445286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623cdb3-1d60-4908-835b-2eedd92aaa34 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:09.445669 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623cdb3-1d60-4908-835b-2eedd92aaa34 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:09.445848 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623cdb3-1d60-4908-835b-2eedd92aaa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:09.464127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d623cdb3-1d60-4908-835b-2eedd92aaa34 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:09.465245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d623cdb3-1d60-4908-835b-2eedd92aaa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:09.473096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:09.514182 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2832ca-46de-43d1-a52f-e547dcaab9fd None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:09.529101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2832ca-46de-43d1-a52f-e547dcaab9fd None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:09.534474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fe554-64d0-4a2f-a378-9add11dbbe2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:09.535114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe554-64d0-4a2f-a378-9add11dbbe2d service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:09.535399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe554-64d0-4a2f-a378-9add11dbbe2d service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:09.535679 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe554-64d0-4a2f-a378-9add11dbbe2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:09.543782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fe554-64d0-4a2f-a378-9add11dbbe2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:09.545395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fe554-64d0-4a2f-a378-9add11dbbe2d service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:09.554697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 711/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:10.490710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f033e-9348-4c6b-bc64-557d7024eba6 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.491283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f033e-9348-4c6b-bc64-557d7024eba6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.491283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f033e-9348-4c6b-bc64-557d7024eba6 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.492761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:10.497470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a655-aeda-4573-97df-8bc604bdfee7 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.497908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a655-aeda-4573-97df-8bc604bdfee7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.498037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a655-aeda-4573-97df-8bc604bdfee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.515780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4934a655-aeda-4573-97df-8bc604bdfee7 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:10.517589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4934a655-aeda-4573-97df-8bc604bdfee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:10.525439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:10.678426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f033e-9348-4c6b-bc64-557d7024eba6 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:10.692398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f033e-9348-4c6b-bc64-557d7024eba6 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:10.697679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01326d-8819-450c-9313-cf359fc319f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:10.698312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01326d-8819-450c-9313-cf359fc319f7 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.698598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01326d-8819-450c-9313-cf359fc319f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.698876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01326d-8819-450c-9313-cf359fc319f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.707387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01326d-8819-450c-9313-cf359fc319f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:10.708987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01326d-8819-450c-9313-cf359fc319f7 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:10.718525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 707/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:11.637911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b77ca-acfc-41b1-b28a-e36188c4d7ff None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:11.638491 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b77ca-acfc-41b1-b28a-e36188c4d7ff None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:11.638595 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b77ca-acfc-41b1-b28a-e36188c4d7ff None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:11.639911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:11.644854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc0e5f-1c40-46fe-8a7c-a2c01d33cceb None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:11.645251 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc0e5f-1c40-46fe-8a7c-a2c01d33cceb None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:11.645419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc0e5f-1c40-46fe-8a7c-a2c01d33cceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:11.663415 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-46dc0e5f-1c40-46fe-8a7c-a2c01d33cceb None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:11.664621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-46dc0e5f-1c40-46fe-8a7c-a2c01d33cceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:11.672204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:11.819309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b77ca-acfc-41b1-b28a-e36188c4d7ff None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:11.834433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b77ca-acfc-41b1-b28a-e36188c4d7ff None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:11.839682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2a0c4-b61f-4dca-b2db-d9817a372d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:11.840353 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2a0c4-b61f-4dca-b2db-d9817a372d0c service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:11.840638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2a0c4-b61f-4dca-b2db-d9817a372d0c service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:11.840918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2a0c4-b61f-4dca-b2db-d9817a372d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:11.849405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2a0c4-b61f-4dca-b2db-d9817a372d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:11.850981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2a0c4-b61f-4dca-b2db-d9817a372d0c service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:11.860166 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 714/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:12.761470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2c711-eee5-4298-ae81-7967c2eac016 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:12.762042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2c711-eee5-4298-ae81-7967c2eac016 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:12.762042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2c711-eee5-4298-ae81-7967c2eac016 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:12.763403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:12.768864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5d1f-4bc8-47c9-ba44-b5da8f8656b4 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:12.769273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5d1f-4bc8-47c9-ba44-b5da8f8656b4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:12.769446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5d1f-4bc8-47c9-ba44-b5da8f8656b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:12.786855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-fe1e5d1f-4bc8-47c9-ba44-b5da8f8656b4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:12.788072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fe1e5d1f-4bc8-47c9-ba44-b5da8f8656b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:12.795662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:12.945117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2c711-eee5-4298-ae81-7967c2eac016 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:12.959468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2c711-eee5-4298-ae81-7967c2eac016 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:12.965124 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacaec3-cc13-43da-a67e-a2186fd4645e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:12.965769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacaec3-cc13-43da-a67e-a2186fd4645e service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:12.966056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacaec3-cc13-43da-a67e-a2186fd4645e service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:12.966336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacaec3-cc13-43da-a67e-a2186fd4645e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:12.974532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacaec3-cc13-43da-a67e-a2186fd4645e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:12.976133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacaec3-cc13-43da-a67e-a2186fd4645e service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:12.985834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 710/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:13.884238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece168ab-3fe0-4edc-b239-2908a2d073ce None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:13.884801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece168ab-3fe0-4edc-b239-2908a2d073ce None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:13.884801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece168ab-3fe0-4edc-b239-2908a2d073ce None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:13.886198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:13.890956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37dd03-fea0-4be7-83b3-dc1e23032520 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:13.891389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37dd03-fea0-4be7-83b3-dc1e23032520 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:13.891560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37dd03-fea0-4be7-83b3-dc1e23032520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:13.910775 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-8e37dd03-fea0-4be7-83b3-dc1e23032520 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:13.911982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8e37dd03-fea0-4be7-83b3-dc1e23032520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:13.919593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:14.068552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece168ab-3fe0-4edc-b239-2908a2d073ce None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:14.082581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece168ab-3fe0-4edc-b239-2908a2d073ce None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:14.088118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e583b-11df-4e8a-bdf1-900ac4dfeddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:14.088745 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e583b-11df-4e8a-bdf1-900ac4dfeddb service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.089022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e583b-11df-4e8a-bdf1-900ac4dfeddb service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.089296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e583b-11df-4e8a-bdf1-900ac4dfeddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.097696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e583b-11df-4e8a-bdf1-900ac4dfeddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:14.099290 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e583b-11df-4e8a-bdf1-900ac4dfeddb service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:14.108700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 717/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:14.956112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb9153-c38e-43a9-ab11-7350727e525c None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.956685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb9153-c38e-43a9-ab11-7350727e525c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.956685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb9153-c38e-43a9-ab11-7350727e525c None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.958040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:14.963228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f23f8-3b2d-4cff-a8ce-c017de1225a3 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.963625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f23f8-3b2d-4cff-a8ce-c017de1225a3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.963785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f23f8-3b2d-4cff-a8ce-c017de1225a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.981533 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-9c2f23f8-3b2d-4cff-a8ce-c017de1225a3 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:14.982718 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9c2f23f8-3b2d-4cff-a8ce-c017de1225a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:14.990960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:15.139806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb9153-c38e-43a9-ab11-7350727e525c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:15.154310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb9153-c38e-43a9-ab11-7350727e525c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:15.160206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de4a92-6a5e-4883-aec5-2ae5c1719e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:15.160836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de4a92-6a5e-4883-aec5-2ae5c1719e82 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:15.161117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de4a92-6a5e-4883-aec5-2ae5c1719e82 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:15.161421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de4a92-6a5e-4883-aec5-2ae5c1719e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:15.169286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de4a92-6a5e-4883-aec5-2ae5c1719e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:15.170855 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de4a92-6a5e-4883-aec5-2ae5c1719e82 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:15.179910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 713/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:16.021801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72a5d-7ce3-4c1b-878d-a3daa4cf2f0a None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:16.022361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72a5d-7ce3-4c1b-878d-a3daa4cf2f0a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:16.022361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72a5d-7ce3-4c1b-878d-a3daa4cf2f0a None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:16.023742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:16.028610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48a5d-3c47-4c20-af44-b120bc4be828 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:16.029014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48a5d-3c47-4c20-af44-b120bc4be828 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:16.029166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48a5d-3c47-4c20-af44-b120bc4be828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:16.047173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-19e48a5d-3c47-4c20-af44-b120bc4be828 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:16.048430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-19e48a5d-3c47-4c20-af44-b120bc4be828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:16.055946 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:18:16.206028 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72a5d-7ce3-4c1b-878d-a3daa4cf2f0a None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:16.222367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72a5d-7ce3-4c1b-878d-a3daa4cf2f0a None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:16.227663 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087c614-36ee-4a2d-9e9c-b8d6a5560e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:16.228332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c614-36ee-4a2d-9e9c-b8d6a5560e1c service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:16.228622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c614-36ee-4a2d-9e9c-b8d6a5560e1c service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:16.228899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c614-36ee-4a2d-9e9c-b8d6a5560e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:16.236908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087c614-36ee-4a2d-9e9c-b8d6a5560e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:16.238475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087c614-36ee-4a2d-9e9c-b8d6a5560e1c service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:16.247730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 720/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:17.084496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68497912-e3bf-4243-a0a4-fb4e578a92f1 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.085018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68497912-e3bf-4243-a0a4-fb4e578a92f1 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.085112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68497912-e3bf-4243-a0a4-fb4e578a92f1 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.086420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:17.091165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cffb9a-b872-42a6-bfd1-aea9de20d67b None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.091569 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cffb9a-b872-42a6-bfd1-aea9de20d67b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.091744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cffb9a-b872-42a6-bfd1-aea9de20d67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.109872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b2cffb9a-b872-42a6-bfd1-aea9de20d67b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:17.111655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b2cffb9a-b872-42a6-bfd1-aea9de20d67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:17.119716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:17.270339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68497912-e3bf-4243-a0a4-fb4e578a92f1 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:17.285244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68497912-e3bf-4243-a0a4-fb4e578a92f1 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:17.290538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d502e-7ec6-44a7-85cc-60356d9bc204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:17.291174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d502e-7ec6-44a7-85cc-60356d9bc204 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.291456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d502e-7ec6-44a7-85cc-60356d9bc204 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.291732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d502e-7ec6-44a7-85cc-60356d9bc204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.299956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d502e-7ec6-44a7-85cc-60356d9bc204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:17.301555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d502e-7ec6-44a7-85cc-60356d9bc204 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:17.310726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 716/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:18.164453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab544-185d-4f96-8d1b-60925dde1b6f None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:18.165003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab544-185d-4f96-8d1b-60925dde1b6f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:18.165119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab544-185d-4f96-8d1b-60925dde1b6f None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:18.166414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:18.171296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbae41-f762-49c1-a7af-703559c5852b None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:18.171733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbae41-f762-49c1-a7af-703559c5852b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:18.171836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbae41-f762-49c1-a7af-703559c5852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:18.190806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-3ebbae41-f762-49c1-a7af-703559c5852b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:18.192013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3ebbae41-f762-49c1-a7af-703559c5852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:18.199718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:18.350535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dab544-185d-4f96-8d1b-60925dde1b6f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:18.365070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dab544-185d-4f96-8d1b-60925dde1b6f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:18.370550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c01ed-3241-4d9e-a4b3-52f62a46f4b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:18.371189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c01ed-3241-4d9e-a4b3-52f62a46f4b9 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:18.371473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c01ed-3241-4d9e-a4b3-52f62a46f4b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:18.371771 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c01ed-3241-4d9e-a4b3-52f62a46f4b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:18.380528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c01ed-3241-4d9e-a4b3-52f62a46f4b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:18.382086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c01ed-3241-4d9e-a4b3-52f62a46f4b9 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:18.391158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 723/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:20.403922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c9bc6-538b-43d8-90a7-02f97ecf7525 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:20.404499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c9bc6-538b-43d8-90a7-02f97ecf7525 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:20.404499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c9bc6-538b-43d8-90a7-02f97ecf7525 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:20.405885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:20.411187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d2635-8373-4650-a54d-c3bc0ea3623c None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:20.411594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d2635-8373-4650-a54d-c3bc0ea3623c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:20.411763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d2635-8373-4650-a54d-c3bc0ea3623c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:20.430617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e23d2635-8373-4650-a54d-c3bc0ea3623c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:20.433197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e23d2635-8373-4650-a54d-c3bc0ea3623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:20.443737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:20.481375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c9bc6-538b-43d8-90a7-02f97ecf7525 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:20.492477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c9bc6-538b-43d8-90a7-02f97ecf7525 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:20.496140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422402af-4e68-4a6c-ae58-3eec5554b8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:20.496778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422402af-4e68-4a6c-ae58-3eec5554b8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:20.497061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422402af-4e68-4a6c-ae58-3eec5554b8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:20.497336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422402af-4e68-4a6c-ae58-3eec5554b8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:20.506749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422402af-4e68-4a6c-ae58-3eec5554b8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:20.508202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422402af-4e68-4a6c-ae58-3eec5554b8e8 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:20.517274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 719/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:22.798578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09313634-0b06-4f45-9db9-854fb4ec049a None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:22.799174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09313634-0b06-4f45-9db9-854fb4ec049a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:22.799174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09313634-0b06-4f45-9db9-854fb4ec049a None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:22.800548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:22.805841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89de66d-2c0b-4cab-805a-34c0ca789e4b None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:22.806285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89de66d-2c0b-4cab-805a-34c0ca789e4b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:22.806391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89de66d-2c0b-4cab-805a-34c0ca789e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:22.824410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-f89de66d-2c0b-4cab-805a-34c0ca789e4b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:22.825903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f89de66d-2c0b-4cab-805a-34c0ca789e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:22.834813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:22.872035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09313634-0b06-4f45-9db9-854fb4ec049a None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:22.883447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09313634-0b06-4f45-9db9-854fb4ec049a None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:22.886978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6733-da62-4177-8341-799741025c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:22.887615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6733-da62-4177-8341-799741025c47 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:22.887904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6733-da62-4177-8341-799741025c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:22.888234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6733-da62-4177-8341-799741025c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:22.897125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6733-da62-4177-8341-799741025c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:22.898550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6733-da62-4177-8341-799741025c47 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:22.908560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 726/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:25.408719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b3674-5b98-4f1b-8df1-b75569afcd47 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:25.409309 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b3674-5b98-4f1b-8df1-b75569afcd47 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:25.409309 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b3674-5b98-4f1b-8df1-b75569afcd47 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:25.410691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:25.415778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a802a-358b-42dd-8379-425907df0ccf None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:25.416233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a802a-358b-42dd-8379-425907df0ccf None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:25.416411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a802a-358b-42dd-8379-425907df0ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:25.434205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-746a802a-358b-42dd-8379-425907df0ccf None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:25.435410 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-746a802a-358b-42dd-8379-425907df0ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:25.443164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:25.480912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b3674-5b98-4f1b-8df1-b75569afcd47 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:25.492035 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b3674-5b98-4f1b-8df1-b75569afcd47 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:25.495461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab86324-c89d-4175-af91-2397cbca5961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:25.496132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab86324-c89d-4175-af91-2397cbca5961 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:25.496412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab86324-c89d-4175-af91-2397cbca5961 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:25.496684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab86324-c89d-4175-af91-2397cbca5961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:25.505258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab86324-c89d-4175-af91-2397cbca5961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:25.506669 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab86324-c89d-4175-af91-2397cbca5961 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:25.515766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 722/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:27.760890 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad5fc4-8933-4ae8-931d-548e7f986cf2 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:27.761444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad5fc4-8933-4ae8-931d-548e7f986cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:27.761444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad5fc4-8933-4ae8-931d-548e7f986cf2 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:27.762833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:27.768986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e420116-e077-471b-8c12-03bce334f35f None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:27.769421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e420116-e077-471b-8c12-03bce334f35f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:27.769599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e420116-e077-471b-8c12-03bce334f35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:27.787293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0e420116-e077-471b-8c12-03bce334f35f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:27.788457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0e420116-e077-471b-8c12-03bce334f35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:27.796514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:27.836070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad5fc4-8933-4ae8-931d-548e7f986cf2 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:27.846629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad5fc4-8933-4ae8-931d-548e7f986cf2 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:27.850130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8dcca0-4442-4f90-9043-f6c258af5712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:27.850767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dcca0-4442-4f90-9043-f6c258af5712 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:27.851053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dcca0-4442-4f90-9043-f6c258af5712 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:27.851332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dcca0-4442-4f90-9043-f6c258af5712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:27.860566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8dcca0-4442-4f90-9043-f6c258af5712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:27.861984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8dcca0-4442-4f90-9043-f6c258af5712 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:27.871153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 729/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:30.057011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe71d-e3b6-495e-987f-073c17d3b97c None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:30.057542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe71d-e3b6-495e-987f-073c17d3b97c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:30.057542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe71d-e3b6-495e-987f-073c17d3b97c None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:30.058939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:30.064769 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca778b-bc5c-45af-8e42-9cce4d180888 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:30.065198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca778b-bc5c-45af-8e42-9cce4d180888 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:30.065322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca778b-bc5c-45af-8e42-9cce4d180888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:30.082687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-92ca778b-bc5c-45af-8e42-9cce4d180888 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:30.084170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-92ca778b-bc5c-45af-8e42-9cce4d180888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:30.091823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:30.128941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abe71d-e3b6-495e-987f-073c17d3b97c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:30.139456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abe71d-e3b6-495e-987f-073c17d3b97c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:30.142986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f354e9d-aa30-4697-bc3f-0b80ad488aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:30.143618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354e9d-aa30-4697-bc3f-0b80ad488aea service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:30.143903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354e9d-aa30-4697-bc3f-0b80ad488aea service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:30.144222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354e9d-aa30-4697-bc3f-0b80ad488aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:30.152984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f354e9d-aa30-4697-bc3f-0b80ad488aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:30.154399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f354e9d-aa30-4697-bc3f-0b80ad488aea service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:30.163734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 725/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:32.353451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed56550-85d6-47d5-a1d6-b896bc476de4 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:32.353975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed56550-85d6-47d5-a1d6-b896bc476de4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:32.354070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed56550-85d6-47d5-a1d6-b896bc476de4 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:32.355373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:32.361139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58df8e6-caf3-4618-9a40-2925d5af2874 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:32.361569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58df8e6-caf3-4618-9a40-2925d5af2874 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:32.361707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58df8e6-caf3-4618-9a40-2925d5af2874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:32.379556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-c58df8e6-caf3-4618-9a40-2925d5af2874 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:32.380781 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c58df8e6-caf3-4618-9a40-2925d5af2874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:32.388519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:32.425369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed56550-85d6-47d5-a1d6-b896bc476de4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:32.435744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed56550-85d6-47d5-a1d6-b896bc476de4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:32.439308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585eb4d-e6dd-4f55-ab53-90377b2dbbd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:32.439936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585eb4d-e6dd-4f55-ab53-90377b2dbbd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:32.440251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585eb4d-e6dd-4f55-ab53-90377b2dbbd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:32.440529 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585eb4d-e6dd-4f55-ab53-90377b2dbbd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:32.449136 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585eb4d-e6dd-4f55-ab53-90377b2dbbd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:32.450553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585eb4d-e6dd-4f55-ab53-90377b2dbbd3 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:32.460446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 732/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:34.630451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b14b1-52ae-4e2e-931b-84c46b0b86a8 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:34.631038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b14b1-52ae-4e2e-931b-84c46b0b86a8 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:34.631038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b14b1-52ae-4e2e-931b-84c46b0b86a8 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:34.632423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:34.637721 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef98d9d-aa1e-45f5-ba5a-fbb58ae1b328 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:34.638169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef98d9d-aa1e-45f5-ba5a-fbb58ae1b328 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:34.638278 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef98d9d-aa1e-45f5-ba5a-fbb58ae1b328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:34.655467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-0ef98d9d-aa1e-45f5-ba5a-fbb58ae1b328 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:34.656706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-0ef98d9d-aa1e-45f5-ba5a-fbb58ae1b328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:34.664383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:34.701454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b14b1-52ae-4e2e-931b-84c46b0b86a8 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:34.712276 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b14b1-52ae-4e2e-931b-84c46b0b86a8 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:34.715726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fa36a-4b2d-474a-8d17-c0ec80f30fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:34.716398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fa36a-4b2d-474a-8d17-c0ec80f30fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:34.716685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fa36a-4b2d-474a-8d17-c0ec80f30fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:34.716964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fa36a-4b2d-474a-8d17-c0ec80f30fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:34.725695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fa36a-4b2d-474a-8d17-c0ec80f30fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:34.727119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fa36a-4b2d-474a-8d17-c0ec80f30fc7 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:34.736778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 728/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:36.888512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d413d-48c7-4cf4-bc63-7ca82ecf27eb None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:36.889101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d413d-48c7-4cf4-bc63-7ca82ecf27eb None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:36.889101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d413d-48c7-4cf4-bc63-7ca82ecf27eb None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:36.890501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:36.895626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e21df3-83a4-4bdc-9356-36564420ed07 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:36.896018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e21df3-83a4-4bdc-9356-36564420ed07 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:36.896220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e21df3-83a4-4bdc-9356-36564420ed07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:36.902180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=79 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:36.914725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-59e21df3-83a4-4bdc-9356-36564420ed07 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:36.915921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-59e21df3-83a4-4bdc-9356-36564420ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:36.924262 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:36.960659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d413d-48c7-4cf4-bc63-7ca82ecf27eb None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:36.966305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=73 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:36.972882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d413d-48c7-4cf4-bc63-7ca82ecf27eb None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:36.976365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854f5e3-8900-4d0c-bf03-0244d6a809da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:36.977005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854f5e3-8900-4d0c-bf03-0244d6a809da service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:36.977291 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854f5e3-8900-4d0c-bf03-0244d6a809da service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:36.977570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854f5e3-8900-4d0c-bf03-0244d6a809da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:36.986882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854f5e3-8900-4d0c-bf03-0244d6a809da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:36.988330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854f5e3-8900-4d0c-bf03-0244d6a809da service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:36.997673 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 735/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:39.125873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea616ee-08fd-48b8-a9e6-e464d50df8db None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:39.126468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea616ee-08fd-48b8-a9e6-e464d50df8db None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:39.126468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea616ee-08fd-48b8-a9e6-e464d50df8db None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:39.127789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:39.132898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a8c3f-8305-4934-9df5-30ac4cb8aaf2 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:39.133324 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a8c3f-8305-4934-9df5-30ac4cb8aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:39.133458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a8c3f-8305-4934-9df5-30ac4cb8aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:39.150745 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-452a8c3f-8305-4934-9df5-30ac4cb8aaf2 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:39.151926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-452a8c3f-8305-4934-9df5-30ac4cb8aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:39.159565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:39.196337 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea616ee-08fd-48b8-a9e6-e464d50df8db None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:39.206744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea616ee-08fd-48b8-a9e6-e464d50df8db None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:39.210457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036d05c-8bc6-42d9-ad9b-d9fc516cf81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:39.211090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036d05c-8bc6-42d9-ad9b-d9fc516cf81d service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:39.211377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036d05c-8bc6-42d9-ad9b-d9fc516cf81d service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:39.211658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036d05c-8bc6-42d9-ad9b-d9fc516cf81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:39.220487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036d05c-8bc6-42d9-ad9b-d9fc516cf81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:39.221908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036d05c-8bc6-42d9-ad9b-d9fc516cf81d service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:39.231119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 731/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:41.384367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ac3a6-61ab-4d12-9447-d8569c304391 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:41.384928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ac3a6-61ab-4d12-9447-d8569c304391 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:41.384928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ac3a6-61ab-4d12-9447-d8569c304391 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:41.386314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:41.391579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423082e6-ab13-4b5c-80df-d730995acf92 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:41.392032 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423082e6-ab13-4b5c-80df-d730995acf92 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:41.392178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423082e6-ab13-4b5c-80df-d730995acf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:41.409829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-423082e6-ab13-4b5c-80df-d730995acf92 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:41.411024 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-423082e6-ab13-4b5c-80df-d730995acf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:41.418788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:41.454809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ac3a6-61ab-4d12-9447-d8569c304391 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:41.465738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ac3a6-61ab-4d12-9447-d8569c304391 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:41.469258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79daf6-c41b-43d5-aa65-884bfd60367d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:41.469894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79daf6-c41b-43d5-aa65-884bfd60367d service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:41.470181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79daf6-c41b-43d5-aa65-884bfd60367d service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:41.470459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79daf6-c41b-43d5-aa65-884bfd60367d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:41.479147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79daf6-c41b-43d5-aa65-884bfd60367d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:41.480642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79daf6-c41b-43d5-aa65-884bfd60367d service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:41.490509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 738/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:51.404757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=11 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:51.486305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=14 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:01.302304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c899d-01b9-4e7a-9cd9-46d776ff8a2e None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:01.302829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c899d-01b9-4e7a-9cd9-46d776ff8a2e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:01.302829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c899d-01b9-4e7a-9cd9-46d776ff8a2e None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:01.304291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 733/1471] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:01.309467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205e58-cad7-486e-a536-c9cb162e6c51 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:01.309944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205e58-cad7-486e-a536-c9cb162e6c51 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:01.310052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205e58-cad7-486e-a536-c9cb162e6c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:01.328349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-77205e58-cad7-486e-a536-c9cb162e6c51 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:01.329537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-77205e58-cad7-486e-a536-c9cb162e6c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:01.337422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 739/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:01.383320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f553d3-a3c0-4cb0-981d-0552311c6b82 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:01.383614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f553d3-a3c0-4cb0-981d-0552311c6b82 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:01.383895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f553d3-a3c0-4cb0-981d-0552311c6b82 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:01.385322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 734/1473] 10.222.0.16 () {54 vars in 962 bytes} [Thu Jun 16 00:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:01.390871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c164d-77d1-455f-b3e4-1d4eb783f045 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:01.391162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c164d-77d1-455f-b3e4-1d4eb783f045 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:01.391440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c164d-77d1-455f-b3e4-1d4eb783f045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:01.408888 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-1b4c164d-77d1-455f-b3e4-1d4eb783f045 None None] MFA Rules not processed for user `7ee61aece9c64e74806248e4ac49cd47`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:01.410070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1b4c164d-77d1-455f-b3e4-1d4eb783f045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:01.416370 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 740/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Jun 16 00:19:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:01.423633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f553d3-a3c0-4cb0-981d-0552311c6b82 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:01.433925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f553d3-a3c0-4cb0-981d-0552311c6b82 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:01.437895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457b579-8869-45cd-98b2-8ee9ed364689 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee61aece9c64e74806248e4ac49cd47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:01.438513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457b579-8869-45cd-98b2-8ee9ed364689 service glance] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:01.438793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457b579-8869-45cd-98b2-8ee9ed364689 service glance] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:01.439071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457b579-8869-45cd-98b2-8ee9ed364689 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:01.447718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457b579-8869-45cd-98b2-8ee9ed364689 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:01.449170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457b579-8869-45cd-98b2-8ee9ed364689 service glance] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:01.458673 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 735/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:19:03.643051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328d0f-00c0-4c7d-a7fd-258de4047702 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:03.643617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328d0f-00c0-4c7d-a7fd-258de4047702 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:03.643617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328d0f-00c0-4c7d-a7fd-258de4047702 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:03.645017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 741/1476] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:03.650141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18ff3b-ffc9-4ce2-951c-dedf35a9e70e None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:03.650585 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18ff3b-ffc9-4ce2-951c-dedf35a9e70e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:03.650723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18ff3b-ffc9-4ce2-951c-dedf35a9e70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:03.668447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ca18ff3b-ffc9-4ce2-951c-dedf35a9e70e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:03.669625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ca18ff3b-ffc9-4ce2-951c-dedf35a9e70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:03.677798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 736/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:03.700473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69328d0f-00c0-4c7d-a7fd-258de4047702 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:03.712979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69328d0f-00c0-4c7d-a7fd-258de4047702 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:03.717890 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a91ee-6ff9-495c-8253-28574cd999ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:03.718541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a91ee-6ff9-495c-8253-28574cd999ed admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:03.718820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a91ee-6ff9-495c-8253-28574cd999ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:03.719098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a91ee-6ff9-495c-8253-28574cd999ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:03.719826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a91ee-6ff9-495c-8253-28574cd999ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:03.721611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: WARNING py.warnings [None req-fd3a91ee-6ff9-495c-8253-28574cd999ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:19:03.721611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: warnings.warn(msg) Jun 16 00:19:03.721611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: Jun 16 00:19:03.722755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a91ee-6ff9-495c-8253-28574cd999ed admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:03.742578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 742/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 16 00:19:03 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:19:05.877096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d1f09-02d6-467c-8cfe-ecd78e73afcf None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:05.877660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d1f09-02d6-467c-8cfe-ecd78e73afcf None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:05.877660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d1f09-02d6-467c-8cfe-ecd78e73afcf None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:05.879020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 737/1479] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:05.884120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa038-f4a8-4e8b-9133-c7e2aac5f82c None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:05.884549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa038-f4a8-4e8b-9133-c7e2aac5f82c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:05.884696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa038-f4a8-4e8b-9133-c7e2aac5f82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:05.902125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-582fa038-f4a8-4e8b-9133-c7e2aac5f82c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:05.903325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-582fa038-f4a8-4e8b-9133-c7e2aac5f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:05.911056 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 743/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:05.952971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d1f09-02d6-467c-8cfe-ecd78e73afcf None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:05.967275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d1f09-02d6-467c-8cfe-ecd78e73afcf None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:05.972605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b0798-c4f2-41b2-84ee-9f44a145d317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:05.973242 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0798-c4f2-41b2-84ee-9f44a145d317 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:05.973529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0798-c4f2-41b2-84ee-9f44a145d317 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:05.973809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0798-c4f2-41b2-84ee-9f44a145d317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:05.981787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b0798-c4f2-41b2-84ee-9f44a145d317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:05.983394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b0798-c4f2-41b2-84ee-9f44a145d317 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:05.992650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 738/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:08.282681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb862-319d-4bca-bad8-63fb5b22e98b None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:08.283203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb862-319d-4bca-bad8-63fb5b22e98b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:08.283203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb862-319d-4bca-bad8-63fb5b22e98b None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:08.284578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 744/1482] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:08.289840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a81e4-2911-44a0-bcbd-63e494dd5770 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:08.290277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a81e4-2911-44a0-bcbd-63e494dd5770 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:08.290406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a81e4-2911-44a0-bcbd-63e494dd5770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:08.308238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-8b8a81e4-2911-44a0-bcbd-63e494dd5770 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:08.309462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8b8a81e4-2911-44a0-bcbd-63e494dd5770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:08.317869 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 739/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:08.353190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfb862-319d-4bca-bad8-63fb5b22e98b None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:08.364322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfb862-319d-4bca-bad8-63fb5b22e98b None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:08.367847 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2556f-fe85-4e7a-9710-d4aefe5bbde9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:08.368523 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2556f-fe85-4e7a-9710-d4aefe5bbde9 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:08.368817 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2556f-fe85-4e7a-9710-d4aefe5bbde9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:08.369098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2556f-fe85-4e7a-9710-d4aefe5bbde9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:08.378434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2556f-fe85-4e7a-9710-d4aefe5bbde9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:08.379853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2556f-fe85-4e7a-9710-d4aefe5bbde9 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:08.389626 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 745/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:10.545959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b382d-0c3d-4f1b-a2d6-8ec18fe4b9e5 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.546526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b382d-0c3d-4f1b-a2d6-8ec18fe4b9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.546526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b382d-0c3d-4f1b-a2d6-8ec18fe4b9e5 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.547904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 740/1485] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:10.552958 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a0e98-1b03-4b8a-b70a-6d9a1065e921 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.553404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a0e98-1b03-4b8a-b70a-6d9a1065e921 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.553516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a0e98-1b03-4b8a-b70a-6d9a1065e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.571628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-093a0e98-1b03-4b8a-b70a-6d9a1065e921 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:10.572851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-093a0e98-1b03-4b8a-b70a-6d9a1065e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:10.580745 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 746/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:10.618307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b382d-0c3d-4f1b-a2d6-8ec18fe4b9e5 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:10.629344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b382d-0c3d-4f1b-a2d6-8ec18fe4b9e5 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:10.632791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6b927-1528-41a8-aa59-34cf0fd70bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:10.633418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6b927-1528-41a8-aa59-34cf0fd70bcf service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.633699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6b927-1528-41a8-aa59-34cf0fd70bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.633972 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6b927-1528-41a8-aa59-34cf0fd70bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.642610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6b927-1528-41a8-aa59-34cf0fd70bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:10.644058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6b927-1528-41a8-aa59-34cf0fd70bcf service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:10.653110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 741/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:12.849654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03fe5e-6a3b-488e-bce6-91929a1c9149 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:12.850220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03fe5e-6a3b-488e-bce6-91929a1c9149 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:12.850220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03fe5e-6a3b-488e-bce6-91929a1c9149 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:12.851603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 747/1488] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:12.856695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe6d2b-d687-46b1-bf4e-fe0daed30f3d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:12.857101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe6d2b-d687-46b1-bf4e-fe0daed30f3d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:12.857813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe6d2b-d687-46b1-bf4e-fe0daed30f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:12.875552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-18fe6d2b-d687-46b1-bf4e-fe0daed30f3d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:12.876756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-18fe6d2b-d687-46b1-bf4e-fe0daed30f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:12.884359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 742/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:12.923733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03fe5e-6a3b-488e-bce6-91929a1c9149 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:12.934145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03fe5e-6a3b-488e-bce6-91929a1c9149 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:12.938194 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60ed55-8cac-4be2-b146-665849b66ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:12.938820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60ed55-8cac-4be2-b146-665849b66ecc service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:12.939100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60ed55-8cac-4be2-b146-665849b66ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:12.939374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60ed55-8cac-4be2-b146-665849b66ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:12.948121 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60ed55-8cac-4be2-b146-665849b66ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:12.949533 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60ed55-8cac-4be2-b146-665849b66ecc service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:12.958929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 748/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:15.302047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7aca-b45d-4291-b71e-1c5ca74b9cac None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:15.302889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7aca-b45d-4291-b71e-1c5ca74b9cac None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:15.303174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7aca-b45d-4291-b71e-1c5ca74b9cac None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:15.304802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 743/1491] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 16 00:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:15.310242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af4fce-9730-4bd9-a11d-6a24bd1a0436 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:15.310669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af4fce-9730-4bd9-a11d-6a24bd1a0436 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:15.310797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af4fce-9730-4bd9-a11d-6a24bd1a0436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:15.329426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e2af4fce-9730-4bd9-a11d-6a24bd1a0436 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:15.330631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e2af4fce-9730-4bd9-a11d-6a24bd1a0436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:15.338752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 749/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:19:15.377794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec7aca-b45d-4291-b71e-1c5ca74b9cac None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:15.389118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec7aca-b45d-4291-b71e-1c5ca74b9cac None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:15.392662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd662bf-f3d1-4ec2-997c-fb256c6e3576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:15.393299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd662bf-f3d1-4ec2-997c-fb256c6e3576 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:15.393587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd662bf-f3d1-4ec2-997c-fb256c6e3576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:15.393869 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd662bf-f3d1-4ec2-997c-fb256c6e3576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:15.402640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd662bf-f3d1-4ec2-997c-fb256c6e3576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:15.404174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd662bf-f3d1-4ec2-997c-fb256c6e3576 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:15.413470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 744/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:25.323566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=33 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:25.409328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=33 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:00.114801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d198b-4e43-4f3c-9f38-0af04c1c3cfa None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.115310 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d198b-4e43-4f3c-9f38-0af04c1c3cfa None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.115418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d198b-4e43-4f3c-9f38-0af04c1c3cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.133485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f34d198b-4e43-4f3c-9f38-0af04c1c3cfa None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:00.134685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f34d198b-4e43-4f3c-9f38-0af04c1c3cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:00.142395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 750/1494] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:00.151395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b707b-a729-48db-b3f4-1659c34e6af5 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.151894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b707b-a729-48db-b3f4-1659c34e6af5 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.152028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b707b-a729-48db-b3f4-1659c34e6af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.169871 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-276b707b-a729-48db-b3f4-1659c34e6af5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:00.171035 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-276b707b-a729-48db-b3f4-1659c34e6af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:00.178686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 745/1495] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:00.183739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d198b-4e43-4f3c-9f38-0af04c1c3cfa None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.193260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d198b-4e43-4f3c-9f38-0af04c1c3cfa None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.197860 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04780c02-7ece-498d-b759-2c78966b25d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.198512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04780c02-7ece-498d-b759-2c78966b25d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.198795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04780c02-7ece-498d-b759-2c78966b25d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.199072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04780c02-7ece-498d-b759-2c78966b25d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.199786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04780c02-7ece-498d-b759-2c78966b25d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:21:00.200135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04780c02-7ece-498d-b759-2c78966b25d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.201139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: WARNING py.warnings [None req-04780c02-7ece-498d-b759-2c78966b25d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:21:00.201139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: warnings.warn(msg) Jun 16 00:21:00.201139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: Jun 16 00:21:00.202060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04780c02-7ece-498d-b759-2c78966b25d2 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.213626 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 751/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:21:00.221585 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b707b-a729-48db-b3f4-1659c34e6af5 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.231054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b707b-a729-48db-b3f4-1659c34e6af5 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.235562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921682b-ce2f-4c10-9382-9ddb98fe8abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.236245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921682b-ce2f-4c10-9382-9ddb98fe8abe admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.236533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921682b-ce2f-4c10-9382-9ddb98fe8abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.236814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921682b-ce2f-4c10-9382-9ddb98fe8abe admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.237514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921682b-ce2f-4c10-9382-9ddb98fe8abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.239255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: WARNING py.warnings [None req-8921682b-ce2f-4c10-9382-9ddb98fe8abe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:21:00.239255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: warnings.warn(msg) Jun 16 00:21:00.239255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: Jun 16 00:21:00.240470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921682b-ce2f-4c10-9382-9ddb98fe8abe admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.275994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 746/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:21:00 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:21:00.280097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04780c02-7ece-498d-b759-2c78966b25d2 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.290372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04780c02-7ece-498d-b759-2c78966b25d2 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.344424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505409d-ae40-406b-8310-53441fe816ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.345118 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505409d-ae40-406b-8310-53441fe816ad admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.345408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505409d-ae40-406b-8310-53441fe816ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.345688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505409d-ae40-406b-8310-53441fe816ad admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.346415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505409d-ae40-406b-8310-53441fe816ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.347420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: WARNING py.warnings [None req-8505409d-ae40-406b-8310-53441fe816ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:21:00.347420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: warnings.warn(msg) Jun 16 00:21:00.347420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: Jun 16 00:21:00.348649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505409d-ae40-406b-8310-53441fe816ad admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.369010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 752/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:21:00 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:21:00.373119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921682b-ce2f-4c10-9382-9ddb98fe8abe admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.383278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921682b-ce2f-4c10-9382-9ddb98fe8abe admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.387738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864dc85-41e2-464a-86a0-e5fc38086ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.388430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864dc85-41e2-464a-86a0-e5fc38086ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.388715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864dc85-41e2-464a-86a0-e5fc38086ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.388993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864dc85-41e2-464a-86a0-e5fc38086ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.389715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864dc85-41e2-464a-86a0-e5fc38086ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.390721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: WARNING py.warnings [None req-e864dc85-41e2-464a-86a0-e5fc38086ac6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:21:00.390721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: warnings.warn(msg) Jun 16 00:21:00.390721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: Jun 16 00:21:00.391595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864dc85-41e2-464a-86a0-e5fc38086ac6 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.404723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 747/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:21:00.408658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505409d-ae40-406b-8310-53441fe816ad admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.419124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505409d-ae40-406b-8310-53441fe816ad admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.423576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf9aa-52b9-431a-8136-5b29f501e75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.424274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf9aa-52b9-431a-8136-5b29f501e75c admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.424563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf9aa-52b9-431a-8136-5b29f501e75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.424845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf9aa-52b9-431a-8136-5b29f501e75c admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.425565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf9aa-52b9-431a-8136-5b29f501e75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.426567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: WARNING py.warnings [None req-540cf9aa-52b9-431a-8136-5b29f501e75c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:21:00.426567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: warnings.warn(msg) Jun 16 00:21:00.426567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: Jun 16 00:21:00.427443 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf9aa-52b9-431a-8136-5b29f501e75c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.440428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 753/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:21:00.444158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864dc85-41e2-464a-86a0-e5fc38086ac6 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.453652 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864dc85-41e2-464a-86a0-e5fc38086ac6 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.458562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4290217-3c94-4243-9d30-e40b10b571dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.459435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4290217-3c94-4243-9d30-e40b10b571dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.459765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4290217-3c94-4243-9d30-e40b10b571dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.460078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4290217-3c94-4243-9d30-e40b10b571dc admin admin] PATH_INFO: `/v3/projects/bfe2563261594c31b8f727571bf978aa/users/5b4c83f1360a4233a4278a1aae9bef1f/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.474887 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4290217-3c94-4243-9d30-e40b10b571dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe2563261594c31b8f727571bf978aa, user_id=5b4c83f1360a4233a4278a1aae9bef1f, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.475895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: WARNING py.warnings [None req-c4290217-3c94-4243-9d30-e40b10b571dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:21:00.475895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: warnings.warn(msg) Jun 16 00:21:00.475895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: Jun 16 00:21:00.478479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4290217-3c94-4243-9d30-e40b10b571dc admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.490787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 748/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:21:00 2022] PUT /identity/v3/projects/bfe2563261594c31b8f727571bf978aa/users/5b4c83f1360a4233a4278a1aae9bef1f/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:21:00.502230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed581f5b-a0d0-484f-983e-7450273c43af None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.502534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed581f5b-a0d0-484f-983e-7450273c43af None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.502833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed581f5b-a0d0-484f-983e-7450273c43af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.528672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ed581f5b-a0d0-484f-983e-7450273c43af None None] MFA Rules not processed for user `5b4c83f1360a4233a4278a1aae9bef1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:00.529807 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ed581f5b-a0d0-484f-983e-7450273c43af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:00.591425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 754/1502] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:21:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:00.604945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2f4aa-9f24-4188-9906-797e27c8072f None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.605235 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2f4aa-9f24-4188-9906-797e27c8072f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.605514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2f4aa-9f24-4188-9906-797e27c8072f None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.606895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 749/1503] 10.222.0.16 () {54 vars in 963 bytes} [Thu Jun 16 00:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:00.611692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9afb6d-8bd1-4680-9e09-e4ef0a252130 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.612018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9afb6d-8bd1-4680-9e09-e4ef0a252130 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.612309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9afb6d-8bd1-4680-9e09-e4ef0a252130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.629553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-7d9afb6d-8bd1-4680-9e09-e4ef0a252130 None None] MFA Rules not processed for user `b0e658f3947f41a9a3e09ea327b5d8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:00.630738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7d9afb6d-8bd1-4680-9e09-e4ef0a252130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:00.673003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:00.681017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 755/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Jun 16 00:21:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:00.688511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2f4aa-9f24-4188-9906-797e27c8072f None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.698935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2f4aa-9f24-4188-9906-797e27c8072f None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.702430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cefacf-8e95-4635-8ef7-55bb06d62a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.703054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cefacf-8e95-4635-8ef7-55bb06d62a14 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.703337 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cefacf-8e95-4635-8ef7-55bb06d62a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.703614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cefacf-8e95-4635-8ef7-55bb06d62a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.712433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cefacf-8e95-4635-8ef7-55bb06d62a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.713844 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cefacf-8e95-4635-8ef7-55bb06d62a14 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.722356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 750/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:00.765659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43190e-f79d-43d7-bd65-a93173680e8f None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.765955 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43190e-f79d-43d7-bd65-a93173680e8f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.766240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43190e-f79d-43d7-bd65-a93173680e8f None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.767526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 756/1506] 10.222.0.16 () {52 vars in 829 bytes} [Thu Jun 16 00:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:00.771250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cefacf-8e95-4635-8ef7-55bb06d62a14 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:00.832257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cefacf-8e95-4635-8ef7-55bb06d62a14 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:00.837934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:00.838840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.839123 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.839401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] PATH_INFO: `/v3/users/5b4c83f1360a4233a4278a1aae9bef1f` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.840600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4c83f1360a4233a4278a1aae9bef1f)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:00.841607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: WARNING py.warnings [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:21:00.841607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: warnings.warn(msg) Jun 16 00:21:00.841607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: Jun 16 00:21:00.842802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:00.905948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4c83f1360a4233a4278a1aae9bef1f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:21:00.923618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4c83f1360a4233a4278a1aae9bef1f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:21:00.924304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4c83f1360a4233a4278a1aae9bef1f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:21:00.933359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4c83f1360a4233a4278a1aae9bef1f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:21:00.941915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:00.947801 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4c83f1360a4233a4278a1aae9bef1f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:21:00.954653 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 751/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:21:00 2022] DELETE /identity/v3/users/5b4c83f1360a4233a4278a1aae9bef1f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:21:00.959414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a27e08-d25a-4fe0-96da-47f25b383fff None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:00.959706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a27e08-d25a-4fe0-96da-47f25b383fff None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:00.960016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a27e08-d25a-4fe0-96da-47f25b383fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:00.978189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-41a27e08-d25a-4fe0-96da-47f25b383fff None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:00.979433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-41a27e08-d25a-4fe0-96da-47f25b383fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:01.037913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 757/1508] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:01.047337 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:01.048740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:01.105153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbdc5b-8bb7-4d7e-ba06-6fb33be452d3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:01.108769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd53f-1b64-417c-8fb7-7717a17810a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:01.109420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd53f-1b64-417c-8fb7-7717a17810a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.109712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd53f-1b64-417c-8fb7-7717a17810a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.109996 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd53f-1b64-417c-8fb7-7717a17810a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.119363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd53f-1b64-417c-8fb7-7717a17810a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:01.120839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd53f-1b64-417c-8fb7-7717a17810a1 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:01.130125 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 752/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:01.529251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a27e08-d25a-4fe0-96da-47f25b383fff None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:01.530687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-41a27e08-d25a-4fe0-96da-47f25b383fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:01.543330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a27e08-d25a-4fe0-96da-47f25b383fff None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:01.549127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:01.549997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.550280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.550559 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] PATH_INFO: `/v3/projects/bfe2563261594c31b8f727571bf978aa` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.551765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe2563261594c31b8f727571bf978aa)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:01.553670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: WARNING py.warnings [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:21:01.553670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: warnings.warn(msg) Jun 16 00:21:01.553670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: Jun 16 00:21:01.554884 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:01.615537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe2563261594c31b8f727571bf978aa', 'request_id': 'req-7f394cae-1011-487a-adfb-ee2b7034ecbd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:21:01.625402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe2563261594c31b8f727571bf978aa', 'request_id': 'req-7f394cae-1011-487a-adfb-ee2b7034ecbd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:21:01.632083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe2563261594c31b8f727571bf978aa', 'request_id': 'req-7f394cae-1011-487a-adfb-ee2b7034ecbd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:21:01.651089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] The token cache is being invalidate because project bfe2563261594c31b8f727571bf978aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:21:01.651380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:21:01.652160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-7f394cae-1011-487a-adfb-ee2b7034ecbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:21:01.653707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 758/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:21:01 2022] DELETE /identity/v3/projects/bfe2563261594c31b8f727571bf978aa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:21:11.126023 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=29 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:11.647588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:47.572467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e61153-fa91-44e3-987a-c02d2c430c6f None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:47.573061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e61153-fa91-44e3-987a-c02d2c430c6f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:47.573061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e61153-fa91-44e3-987a-c02d2c430c6f None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:47.574406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:47.579680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69084e9d-954b-4c28-a37d-6f3a799109e1 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:47.580103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69084e9d-954b-4c28-a37d-6f3a799109e1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:47.580293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69084e9d-954b-4c28-a37d-6f3a799109e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:47.598738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-69084e9d-954b-4c28-a37d-6f3a799109e1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:47.599995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-69084e9d-954b-4c28-a37d-6f3a799109e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:47.656920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:47.823835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e61153-fa91-44e3-987a-c02d2c430c6f None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:47.825484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-29e61153-fa91-44e3-987a-c02d2c430c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:47.900757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e61153-fa91-44e3-987a-c02d2c430c6f None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:47.906057 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1f5b2-20b8-4378-b24b-720008de9ec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:47.906702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1f5b2-20b8-4378-b24b-720008de9ec9 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:47.907036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1f5b2-20b8-4378-b24b-720008de9ec9 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:47.907263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1f5b2-20b8-4378-b24b-720008de9ec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:47.915731 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1f5b2-20b8-4378-b24b-720008de9ec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:47.917356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1f5b2-20b8-4378-b24b-720008de9ec9 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:47.926585 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 754/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:22:48.803333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5ceb7-d9a4-4db4-9a6f-74761d0efbb8 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:48.803993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5ceb7-d9a4-4db4-9a6f-74761d0efbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:48.804168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5ceb7-d9a4-4db4-9a6f-74761d0efbb8 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:48.805628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:48.810513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143087f-15f5-46bd-b4fa-97fbabb98919 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:48.810928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143087f-15f5-46bd-b4fa-97fbabb98919 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:48.811030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143087f-15f5-46bd-b4fa-97fbabb98919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:48.828705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-a143087f-15f5-46bd-b4fa-97fbabb98919 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:48.829897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a143087f-15f5-46bd-b4fa-97fbabb98919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:48.837709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:48.989606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5ceb7-d9a4-4db4-9a6f-74761d0efbb8 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:49.004225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5ceb7-d9a4-4db4-9a6f-74761d0efbb8 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:49.009687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b3e58-6753-481f-be1c-5111620d4203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:49.010322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b3e58-6753-481f-be1c-5111620d4203 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:49.010611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b3e58-6753-481f-be1c-5111620d4203 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:49.010894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b3e58-6753-481f-be1c-5111620d4203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:49.022298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b3e58-6753-481f-be1c-5111620d4203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:49.023920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b3e58-6753-481f-be1c-5111620d4203 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:49.033620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 761/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:22:49.512612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f643b5-8d1f-434b-bbf4-4aed43cf4350 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:49.512901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f643b5-8d1f-434b-bbf4-4aed43cf4350 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:49.513177 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f643b5-8d1f-434b-bbf4-4aed43cf4350 None None] PATH_INFO: `/v3` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:49.514489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 756/1517] 10.222.0.15 () {54 vars in 925 bytes} [Thu Jun 16 00:22:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:49.526274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296082cf-80e8-47a1-aba8-4356f81a8d19 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:49.526573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296082cf-80e8-47a1-aba8-4356f81a8d19 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:49.526860 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296082cf-80e8-47a1-aba8-4356f81a8d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:49.545297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-296082cf-80e8-47a1-aba8-4356f81a8d19 None None] MFA Rules not processed for user `7dde39c6d85446a681dea24573f0d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:49.546524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-296082cf-80e8-47a1-aba8-4356f81a8d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:49.610634 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 762/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Jun 16 00:22:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:53.473168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29b59-968f-4e87-a242-8db1371370d2 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:53.473696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29b59-968f-4e87-a242-8db1371370d2 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:53.473696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29b59-968f-4e87-a242-8db1371370d2 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:53.475095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 757/1519] 10.222.0.16 () {54 vars in 960 bytes} [Thu Jun 16 00:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:53.480233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6742ac-01ec-4977-9eab-056b3bc484f3 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:53.480691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6742ac-01ec-4977-9eab-056b3bc484f3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:53.480796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6742ac-01ec-4977-9eab-056b3bc484f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:53.498337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-8f6742ac-01ec-4977-9eab-056b3bc484f3 None None] MFA Rules not processed for user `7dde39c6d85446a681dea24573f0d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:53.499526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-8f6742ac-01ec-4977-9eab-056b3bc484f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:53.508442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 763/1520] 10.222.0.16 () {58 vars in 1057 bytes} [Thu Jun 16 00:22:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:53.517499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29b59-968f-4e87-a242-8db1371370d2 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:53.532151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29b59-968f-4e87-a242-8db1371370d2 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:53.537161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e014294-2e40-4c5c-9949-4d7e0844229f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dde39c6d85446a681dea24573f0d6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:53.537793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e014294-2e40-4c5c-9949-4d7e0844229f service placement] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:53.538078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e014294-2e40-4c5c-9949-4d7e0844229f service placement] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:53.538354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e014294-2e40-4c5c-9949-4d7e0844229f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:53.547038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e014294-2e40-4c5c-9949-4d7e0844229f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:53.548708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e014294-2e40-4c5c-9949-4d7e0844229f service placement] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:53.559198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 758/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:22:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:23:00.297048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a87a45-caf7-4a88-8df4-e135202e76b4 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:00.297587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a87a45-caf7-4a88-8df4-e135202e76b4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:00.297587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a87a45-caf7-4a88-8df4-e135202e76b4 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:00.298925 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:00.303760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcafcb-2a0d-4ba7-adcb-f5e4aabf59cb None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:00.304212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcafcb-2a0d-4ba7-adcb-f5e4aabf59cb None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:00.304351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcafcb-2a0d-4ba7-adcb-f5e4aabf59cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:00.322507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ebbcafcb-2a0d-4ba7-adcb-f5e4aabf59cb None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:00.323701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ebbcafcb-2a0d-4ba7-adcb-f5e4aabf59cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:00.332178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:23:00.485213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a87a45-caf7-4a88-8df4-e135202e76b4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:00.500262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a87a45-caf7-4a88-8df4-e135202e76b4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:00.506274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbe363-7d2f-4a3d-93e5-7043271de219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:00.506912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbe363-7d2f-4a3d-93e5-7043271de219 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:00.507208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbe363-7d2f-4a3d-93e5-7043271de219 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:00.507488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbe363-7d2f-4a3d-93e5-7043271de219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:00.515548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbe363-7d2f-4a3d-93e5-7043271de219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:00.517170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbe363-7d2f-4a3d-93e5-7043271de219 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:00.526547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 765/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:23:01.381077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44031ccb-b3db-4448-9a21-0c727dc815f9 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:01.381601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44031ccb-b3db-4448-9a21-0c727dc815f9 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:01.381697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44031ccb-b3db-4448-9a21-0c727dc815f9 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:01.382998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:01.387825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028ce51-6bf6-4da8-8c14-f3fa6ab032cd None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:01.388241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028ce51-6bf6-4da8-8c14-f3fa6ab032cd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:01.388438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028ce51-6bf6-4da8-8c14-f3fa6ab032cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:01.406170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-9028ce51-6bf6-4da8-8c14-f3fa6ab032cd None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:01.407371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9028ce51-6bf6-4da8-8c14-f3fa6ab032cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:01.415167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:23:01.569530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44031ccb-b3db-4448-9a21-0c727dc815f9 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:01.584676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44031ccb-b3db-4448-9a21-0c727dc815f9 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:01.590044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627e800-c9dc-45e5-b25e-d730c7694c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:01.590682 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e800-c9dc-45e5-b25e-d730c7694c03 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:01.590970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e800-c9dc-45e5-b25e-d730c7694c03 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:01.591254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627e800-c9dc-45e5-b25e-d730c7694c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:01.599276 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627e800-c9dc-45e5-b25e-d730c7694c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:01.600887 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627e800-c9dc-45e5-b25e-d730c7694c03 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:01.610140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 761/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:23:05.639233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1a717-0c98-4a70-af04-04a39f9eb132 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:05.639782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1a717-0c98-4a70-af04-04a39f9eb132 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:05.639782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1a717-0c98-4a70-af04-04a39f9eb132 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:05.641231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:05.646935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2763-2756-466e-90e6-fda72d1b7036 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:05.647354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2763-2756-466e-90e6-fda72d1b7036 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:05.647501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2763-2756-466e-90e6-fda72d1b7036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:05.667579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7eae2763-2756-466e-90e6-fda72d1b7036 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:05.668796 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7eae2763-2756-466e-90e6-fda72d1b7036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:05.676629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:23:05.712667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1a717-0c98-4a70-af04-04a39f9eb132 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:05.714381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-8fa1a717-0c98-4a70-af04-04a39f9eb132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:05.771376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1a717-0c98-4a70-af04-04a39f9eb132 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:05.774887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa868fd-eb4b-4467-b5cb-167e6b9685e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:05.775534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa868fd-eb4b-4467-b5cb-167e6b9685e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:05.775822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa868fd-eb4b-4467-b5cb-167e6b9685e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:05.776135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa868fd-eb4b-4467-b5cb-167e6b9685e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:05.785660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa868fd-eb4b-4467-b5cb-167e6b9685e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:05.787097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa868fd-eb4b-4467-b5cb-167e6b9685e9 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:05.792308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:05.797577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 768/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:23:07.884445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9fc45-e2c8-404f-b85d-e3ed4b033c66 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:07.885010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9fc45-e2c8-404f-b85d-e3ed4b033c66 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:07.885010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9fc45-e2c8-404f-b85d-e3ed4b033c66 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:07.886386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:07.891418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733d307-c1ed-4e90-a377-8863dbbbf06f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:07.891838 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733d307-c1ed-4e90-a377-8863dbbbf06f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:07.892017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733d307-c1ed-4e90-a377-8863dbbbf06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:07.909607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c733d307-c1ed-4e90-a377-8863dbbbf06f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:07.910806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c733d307-c1ed-4e90-a377-8863dbbbf06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:07.918510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:23:07.953953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9fc45-e2c8-404f-b85d-e3ed4b033c66 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:07.956161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-29c9fc45-e2c8-404f-b85d-e3ed4b033c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:07.968817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9fc45-e2c8-404f-b85d-e3ed4b033c66 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:07.973099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ad4e8-95a9-42d6-9c3e-505286d503a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:07.973740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ad4e8-95a9-42d6-9c3e-505286d503a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:07.974023 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ad4e8-95a9-42d6-9c3e-505286d503a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:07.974304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ad4e8-95a9-42d6-9c3e-505286d503a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:07.983243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ad4e8-95a9-42d6-9c3e-505286d503a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:07.984702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ad4e8-95a9-42d6-9c3e-505286d503a4 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:07.993976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 764/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:23:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:23:11.572494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffa344-46c5-4596-9813-3db35fd3bc87 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:11.573078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffa344-46c5-4596-9813-3db35fd3bc87 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:11.573078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffa344-46c5-4596-9813-3db35fd3bc87 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:11.574447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:11.579921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babe7ce-6e51-4825-84cf-e54a1e0a6a89 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:11.580369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babe7ce-6e51-4825-84cf-e54a1e0a6a89 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:11.580521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babe7ce-6e51-4825-84cf-e54a1e0a6a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:11.586687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=62 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:11.599516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7babe7ce-6e51-4825-84cf-e54a1e0a6a89 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:11.600738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7babe7ce-6e51-4825-84cf-e54a1e0a6a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:11.608410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:23:11.869731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffa344-46c5-4596-9813-3db35fd3bc87 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:11.871385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-15ffa344-46c5-4596-9813-3db35fd3bc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:11.926982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffa344-46c5-4596-9813-3db35fd3bc87 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:11.930428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777c8c1-af74-466f-b882-7b8b2331eb3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:11.931060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777c8c1-af74-466f-b882-7b8b2331eb3b service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:11.931344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777c8c1-af74-466f-b882-7b8b2331eb3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:11.931618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777c8c1-af74-466f-b882-7b8b2331eb3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:11.940281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777c8c1-af74-466f-b882-7b8b2331eb3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:11.941720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777c8c1-af74-466f-b882-7b8b2331eb3b service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:11.950845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 771/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:23:14.065593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640c3c-4547-46d0-a00d-59f4e430ef03 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:14.066192 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640c3c-4547-46d0-a00d-59f4e430ef03 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:14.066192 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640c3c-4547-46d0-a00d-59f4e430ef03 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:14.067532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:23:14.072560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822de26-4484-4d7f-bea9-245c721b975f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:14.072988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822de26-4484-4d7f-bea9-245c721b975f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:14.073123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822de26-4484-4d7f-bea9-245c721b975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:14.092800 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4822de26-4484-4d7f-bea9-245c721b975f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:23:14.093984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4822de26-4484-4d7f-bea9-245c721b975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:14.105718 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:23:14.368139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b640c3c-4547-46d0-a00d-59f4e430ef03 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:23:14.369820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4b640c3c-4547-46d0-a00d-59f4e430ef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:23:14.383020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b640c3c-4547-46d0-a00d-59f4e430ef03 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:23:14.386644 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc46bd-b4e2-4e88-9107-4b1fcb7258c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:23:14.387296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc46bd-b4e2-4e88-9107-4b1fcb7258c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:23:14.387579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc46bd-b4e2-4e88-9107-4b1fcb7258c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:23:14.387856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc46bd-b4e2-4e88-9107-4b1fcb7258c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:23:14.397426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc46bd-b4e2-4e88-9107-4b1fcb7258c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:23:14.398830 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc46bd-b4e2-4e88-9107-4b1fcb7258c6 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:23:14.408064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 767/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:23:24.086176 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=32 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:23:24.403892 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=8 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:49.020896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735e74b-595d-4ba3-a86d-023044c755d6 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.020896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735e74b-595d-4ba3-a86d-023044c755d6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.021706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735e74b-595d-4ba3-a86d-023044c755d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.054332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a735e74b-595d-4ba3-a86d-023044c755d6 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.057161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a735e74b-595d-4ba3-a86d-023044c755d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.076274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 773/1540] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.083766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbae5e6-f6b2-4174-b727-1d6b321620db None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.086954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbae5e6-f6b2-4174-b727-1d6b321620db None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.086954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbae5e6-f6b2-4174-b727-1d6b321620db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.117762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ecbae5e6-f6b2-4174-b727-1d6b321620db None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.119017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ecbae5e6-f6b2-4174-b727-1d6b321620db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.135503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 768/1541] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.140911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735e74b-595d-4ba3-a86d-023044c755d6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.153605 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735e74b-595d-4ba3-a86d-023044c755d6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.164124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9ea8-9423-45ab-ab62-ec7eda1709d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.165141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9ea8-9423-45ab-ab62-ec7eda1709d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.165656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9ea8-9423-45ab-ab62-ec7eda1709d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.166160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f9ea8-9423-45ab-ab62-ec7eda1709d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.167124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f9ea8-9423-45ab-ab62-ec7eda1709d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:49.167656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f9ea8-9423-45ab-ab62-ec7eda1709d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.169625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f9ea8-9423-45ab-ab62-ec7eda1709d8 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.173901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246acd-bdfc-4054-bea7-dd8683a33c46 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.174146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246acd-bdfc-4054-bea7-dd8683a33c46 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.174408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85246acd-bdfc-4054-bea7-dd8683a33c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.186837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 774/1542] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:49.197942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9ea8-9423-45ab-ab62-ec7eda1709d8 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.210794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-85246acd-bdfc-4054-bea7-dd8683a33c46 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.210794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-85246acd-bdfc-4054-bea7-dd8683a33c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.215877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f9ea8-9423-45ab-ab62-ec7eda1709d8 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.220890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 769/1543] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.222336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67a3a-a9a7-4580-9190-ee1920dc5692 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.222749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67a3a-a9a7-4580-9190-ee1920dc5692 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.223096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67a3a-a9a7-4580-9190-ee1920dc5692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.233564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34dd90-4b3f-41fa-8036-5faec93c64f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.234585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34dd90-4b3f-41fa-8036-5faec93c64f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.235087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34dd90-4b3f-41fa-8036-5faec93c64f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.235608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34dd90-4b3f-41fa-8036-5faec93c64f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.236686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34dd90-4b3f-41fa-8036-5faec93c64f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.237968 dv-cinder-845990-2-smb devstack@keystone.service[81055]: WARNING py.warnings [None req-1b34dd90-4b3f-41fa-8036-5faec93c64f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:24:49.237968 dv-cinder-845990-2-smb devstack@keystone.service[81055]: warnings.warn(msg) Jun 16 00:24:49.237968 dv-cinder-845990-2-smb devstack@keystone.service[81055]: Jun 16 00:24:49.239773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34dd90-4b3f-41fa-8036-5faec93c64f4 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.260228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-c4f67a3a-a9a7-4580-9190-ee1920dc5692 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.261430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c4f67a3a-a9a7-4580-9190-ee1920dc5692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.271531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 770/1544] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.273124 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cf3b1-e837-46e1-9944-74ee78ed31b4 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.273414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cf3b1-e837-46e1-9944-74ee78ed31b4 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.273847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cf3b1-e837-46e1-9944-74ee78ed31b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.294004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 775/1545] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:24:49.295942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bba5e-2d10-4f83-ab8d-78798a29c40e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.296275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bba5e-2d10-4f83-ab8d-78798a29c40e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.296498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2d5cf3b1-e837-46e1-9944-74ee78ed31b4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.296624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bba5e-2d10-4f83-ab8d-78798a29c40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.297777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2d5cf3b1-e837-46e1-9944-74ee78ed31b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.321959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-fe8bba5e-2d10-4f83-ab8d-78798a29c40e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.323599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fe8bba5e-2d10-4f83-ab8d-78798a29c40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.369166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 771/1546] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.370745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf441b-7e6e-4bc4-b8b0-3f75d3114f02 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.371198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf441b-7e6e-4bc4-b8b0-3f75d3114f02 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.371484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf441b-7e6e-4bc4-b8b0-3f75d3114f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.386875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 776/1547] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.388422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e53038-6351-47b8-a6e1-9bbfd0a819ac None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.388718 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e53038-6351-47b8-a6e1-9bbfd0a819ac None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.389003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e53038-6351-47b8-a6e1-9bbfd0a819ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.397146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-1caf441b-7e6e-4bc4-b8b0-3f75d3114f02 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.404349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-1caf441b-7e6e-4bc4-b8b0-3f75d3114f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.410032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a6e53038-6351-47b8-a6e1-9bbfd0a819ac None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.411382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a6e53038-6351-47b8-a6e1-9bbfd0a819ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.415484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 772/1548] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.421996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 777/1549] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.422789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e53038-6351-47b8-a6e1-9bbfd0a819ac None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.425691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a61123-6a1e-429c-94b2-8dd485a8409d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.426063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a61123-6a1e-429c-94b2-8dd485a8409d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.426274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a61123-6a1e-429c-94b2-8dd485a8409d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.434109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e53038-6351-47b8-a6e1-9bbfd0a819ac None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.440952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e985463-dc13-4240-8cc9-c52d4cdf8e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.441792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e985463-dc13-4240-8cc9-c52d4cdf8e01 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.442780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e985463-dc13-4240-8cc9-c52d4cdf8e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.442780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e985463-dc13-4240-8cc9-c52d4cdf8e01 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.443105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e985463-dc13-4240-8cc9-c52d4cdf8e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.444990 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e985463-dc13-4240-8cc9-c52d4cdf8e01 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.445634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-59a61123-6a1e-429c-94b2-8dd485a8409d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.446853 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-59a61123-6a1e-429c-94b2-8dd485a8409d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.455073 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 773/1550] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.456327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db53d7-9d64-4014-b153-522bd76386be None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.456626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db53d7-9d64-4014-b153-522bd76386be None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.456988 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db53d7-9d64-4014-b153-522bd76386be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.466880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 778/1551] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:49.470183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f66b-2bf8-43de-8150-0c5e0260c297 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.470183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f66b-2bf8-43de-8150-0c5e0260c297 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.470183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9f66b-2bf8-43de-8150-0c5e0260c297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.477030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-16db53d7-9d64-4014-b153-522bd76386be None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.478235 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-16db53d7-9d64-4014-b153-522bd76386be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.486720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 774/1552] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.487306 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4cf9f66b-2bf8-43de-8150-0c5e0260c297 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.487513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db53d7-9d64-4014-b153-522bd76386be None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.488544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4cf9f66b-2bf8-43de-8150-0c5e0260c297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.497186 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 779/1553] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.498696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62bfc2-cb56-4cc9-a851-8bb3e51d370f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.498998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62bfc2-cb56-4cc9-a851-8bb3e51d370f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.499298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62bfc2-cb56-4cc9-a851-8bb3e51d370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.503064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db53d7-9d64-4014-b153-522bd76386be None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.507748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25b26c-d9ef-4c12-af73-1edd38ecfd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.508449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25b26c-d9ef-4c12-af73-1edd38ecfd2a admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.508738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25b26c-d9ef-4c12-af73-1edd38ecfd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.509019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25b26c-d9ef-4c12-af73-1edd38ecfd2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.509750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25b26c-d9ef-4c12-af73-1edd38ecfd2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:49.510065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25b26c-d9ef-4c12-af73-1edd38ecfd2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.511086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: WARNING py.warnings [None req-ca25b26c-d9ef-4c12-af73-1edd38ecfd2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:24:49.511086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: warnings.warn(msg) Jun 16 00:24:49.511086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: Jun 16 00:24:49.512000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25b26c-d9ef-4c12-af73-1edd38ecfd2a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.518601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ec62bfc2-cb56-4cc9-a851-8bb3e51d370f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.519800 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ec62bfc2-cb56-4cc9-a851-8bb3e51d370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.533015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 775/1554] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:49.533015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355d0bd-d205-4e54-8091-dfce8e445d58 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.533015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355d0bd-d205-4e54-8091-dfce8e445d58 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.533015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355d0bd-d205-4e54-8091-dfce8e445d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.533459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 780/1555] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.533459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56085a-408b-4635-99c3-db70f3992987 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.533459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56085a-408b-4635-99c3-db70f3992987 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.533459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56085a-408b-4635-99c3-db70f3992987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.549445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6a56085a-408b-4635-99c3-db70f3992987 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.550525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d355d0bd-d205-4e54-8091-dfce8e445d58 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.550670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6a56085a-408b-4635-99c3-db70f3992987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.551727 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d355d0bd-d205-4e54-8091-dfce8e445d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.559763 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 776/1557] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.559955 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 781/1557] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.560749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355d0bd-d205-4e54-8091-dfce8e445d58 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.561363 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56085a-408b-4635-99c3-db70f3992987 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.573088 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355d0bd-d205-4e54-8091-dfce8e445d58 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.573724 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56085a-408b-4635-99c3-db70f3992987 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.578118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df9824-4d3b-4960-9479-ea6fe7cf1293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.578798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df9824-4d3b-4960-9479-ea6fe7cf1293 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.579002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389b838-38e2-48e6-b0ea-d0fd2683ac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.579110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df9824-4d3b-4960-9479-ea6fe7cf1293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.579367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df9824-4d3b-4960-9479-ea6fe7cf1293 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.579549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389b838-38e2-48e6-b0ea-d0fd2683ac7f admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.579835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389b838-38e2-48e6-b0ea-d0fd2683ac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.580154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389b838-38e2-48e6-b0ea-d0fd2683ac7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.580254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df9824-4d3b-4960-9479-ea6fe7cf1293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:49.580460 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df9824-4d3b-4960-9479-ea6fe7cf1293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.580882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389b838-38e2-48e6-b0ea-d0fd2683ac7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.582099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df9824-4d3b-4960-9479-ea6fe7cf1293 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.582460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389b838-38e2-48e6-b0ea-d0fd2683ac7f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.593720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 782/1558] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:49.600659 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 777/1559] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:49.600829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4e738-2e65-4406-9e65-f7b36a9fc5dc None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.600829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4e738-2e65-4406-9e65-f7b36a9fc5dc None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.601028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df9824-4d3b-4960-9479-ea6fe7cf1293 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.601138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4e738-2e65-4406-9e65-f7b36a9fc5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.606491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df9824-4d3b-4960-9479-ea6fe7cf1293 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.612672 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8f1e6-f3cc-41ea-aa80-2594fef75b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.613320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8f1e6-f3cc-41ea-aa80-2594fef75b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.613601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8f1e6-f3cc-41ea-aa80-2594fef75b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.613878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8f1e6-f3cc-41ea-aa80-2594fef75b65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.614331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-28b4e738-2e65-4406-9e65-f7b36a9fc5dc None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.614588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8f1e6-f3cc-41ea-aa80-2594fef75b65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:49.614893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8f1e6-f3cc-41ea-aa80-2594fef75b65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.615546 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-28b4e738-2e65-4406-9e65-f7b36a9fc5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.616556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8f1e6-f3cc-41ea-aa80-2594fef75b65 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.623843 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 783/1560] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.624670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4e738-2e65-4406-9e65-f7b36a9fc5dc None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.628896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 778/1561] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:49.630303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e04ec-539f-4ff7-87a8-70ea5e48f1b4 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.630589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e04ec-539f-4ff7-87a8-70ea5e48f1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.631266 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e04ec-539f-4ff7-87a8-70ea5e48f1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.635148 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4e738-2e65-4406-9e65-f7b36a9fc5dc None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.640617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877dd58-d692-4ab2-9214-fc196deaca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.641273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877dd58-d692-4ab2-9214-fc196deaca00 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.641558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877dd58-d692-4ab2-9214-fc196deaca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.641840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877dd58-d692-4ab2-9214-fc196deaca00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.642563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877dd58-d692-4ab2-9214-fc196deaca00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.644539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877dd58-d692-4ab2-9214-fc196deaca00 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.653909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-f65e04ec-539f-4ff7-87a8-70ea5e48f1b4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:49.655711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f65e04ec-539f-4ff7-87a8-70ea5e48f1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:49.664288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 779/1562] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:49.665003 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e04ec-539f-4ff7-87a8-70ea5e48f1b4 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.672128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 784/1563] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:49.672955 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877dd58-d692-4ab2-9214-fc196deaca00 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.674748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e04ec-539f-4ff7-87a8-70ea5e48f1b4 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.713842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:49.736234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201e3f3-1f31-44df-a8e6-d18d392e2a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.737162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201e3f3-1f31-44df-a8e6-d18d392e2a87 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.737456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201e3f3-1f31-44df-a8e6-d18d392e2a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.737852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201e3f3-1f31-44df-a8e6-d18d392e2a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.738284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877dd58-d692-4ab2-9214-fc196deaca00 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.738590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201e3f3-1f31-44df-a8e6-d18d392e2a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:49.738965 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201e3f3-1f31-44df-a8e6-d18d392e2a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.740700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201e3f3-1f31-44df-a8e6-d18d392e2a87 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.742920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5662627-0f39-46fb-8a2c-a2278ca0ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.743576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5662627-0f39-46fb-8a2c-a2278ca0ef3c admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.743862 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5662627-0f39-46fb-8a2c-a2278ca0ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.744170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5662627-0f39-46fb-8a2c-a2278ca0ef3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.744887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5662627-0f39-46fb-8a2c-a2278ca0ef3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:49.745193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5662627-0f39-46fb-8a2c-a2278ca0ef3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.746764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5662627-0f39-46fb-8a2c-a2278ca0ef3c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.752207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 780/1564] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:49.753009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201e3f3-1f31-44df-a8e6-d18d392e2a87 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.757830 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:49.758248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 785/1565] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:49.759907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5662627-0f39-46fb-8a2c-a2278ca0ef3c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.766986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201e3f3-1f31-44df-a8e6-d18d392e2a87 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.769915 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5662627-0f39-46fb-8a2c-a2278ca0ef3c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.771747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee080a-d4fc-42ca-93f8-11aeb15dc896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.772485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee080a-d4fc-42ca-93f8-11aeb15dc896 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.772775 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee080a-d4fc-42ca-93f8-11aeb15dc896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.773060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee080a-d4fc-42ca-93f8-11aeb15dc896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.773802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee080a-d4fc-42ca-93f8-11aeb15dc896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.774417 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0cd3-e5ec-4bf7-896b-c862b99949d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.775057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0cd3-e5ec-4bf7-896b-c862b99949d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.775343 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0cd3-e5ec-4bf7-896b-c862b99949d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.775443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee080a-d4fc-42ca-93f8-11aeb15dc896 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.775639 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0cd3-e5ec-4bf7-896b-c862b99949d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.776335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d0cd3-e5ec-4bf7-896b-c862b99949d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.778216 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d0cd3-e5ec-4bf7-896b-c862b99949d3 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.786543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 781/1566] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:49.787338 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee080a-d4fc-42ca-93f8-11aeb15dc896 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.797193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee080a-d4fc-42ca-93f8-11aeb15dc896 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.802629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04fe5-474e-44af-9edd-f24caed62dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.803275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04fe5-474e-44af-9edd-f24caed62dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.803558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04fe5-474e-44af-9edd-f24caed62dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.803833 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04fe5-474e-44af-9edd-f24caed62dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.804587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d04fe5-474e-44af-9edd-f24caed62dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:49.804896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d04fe5-474e-44af-9edd-f24caed62dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.806505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d04fe5-474e-44af-9edd-f24caed62dd0 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.810102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 786/1567] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:49.810102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0cd3-e5ec-4bf7-896b-c862b99949d3 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.818226 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 782/1568] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:49.819030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04fe5-474e-44af-9edd-f24caed62dd0 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.835392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04fe5-474e-44af-9edd-f24caed62dd0 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.869035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0cd3-e5ec-4bf7-896b-c862b99949d3 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.874261 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658f6ff-3fb6-4325-9997-4eddf59d11ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.874894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f6ff-3fb6-4325-9997-4eddf59d11ae admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.875191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f6ff-3fb6-4325-9997-4eddf59d11ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.875475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f6ff-3fb6-4325-9997-4eddf59d11ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.876217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658f6ff-3fb6-4325-9997-4eddf59d11ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.878123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658f6ff-3fb6-4325-9997-4eddf59d11ae admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.893185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a3250-df94-4519-ac9a-48129a465015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.893845 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a3250-df94-4519-ac9a-48129a465015 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.894129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a3250-df94-4519-ac9a-48129a465015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.894410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a3250-df94-4519-ac9a-48129a465015 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.895122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a3250-df94-4519-ac9a-48129a465015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:24:49.895432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a3250-df94-4519-ac9a-48129a465015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.897102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a3250-df94-4519-ac9a-48129a465015 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.903362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 787/1569] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/projects => generated 355 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:49.904231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658f6ff-3fb6-4325-9997-4eddf59d11ae admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.915790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 783/1570] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:49.915790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a3250-df94-4519-ac9a-48129a465015 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:49.918890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a3250-df94-4519-ac9a-48129a465015 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.974908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658f6ff-3fb6-4325-9997-4eddf59d11ae admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:49.976203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eede7a-3845-4a78-849a-e3455cd4017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.976882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eede7a-3845-4a78-849a-e3455cd4017e admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.977172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eede7a-3845-4a78-849a-e3455cd4017e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.977459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eede7a-3845-4a78-849a-e3455cd4017e admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.978180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eede7a-3845-4a78-849a-e3455cd4017e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.979621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8a778-dc47-4908-9488-10e0a0dc60b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:49.980161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eede7a-3845-4a78-849a-e3455cd4017e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:49.980325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a778-dc47-4908-9488-10e0a0dc60b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:49.980615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a778-dc47-4908-9488-10e0a0dc60b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:49.980906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a778-dc47-4908-9488-10e0a0dc60b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:49.981594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8a778-dc47-4908-9488-10e0a0dc60b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:49.983534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8a778-dc47-4908-9488-10e0a0dc60b8 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.004414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 788/1571] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:50.005277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8a778-dc47-4908-9488-10e0a0dc60b8 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.011140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 784/1572] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:24:49 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:50.012263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eede7a-3845-4a78-849a-e3455cd4017e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.020981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8a778-dc47-4908-9488-10e0a0dc60b8 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.039950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:50.074947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:50.079690 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eede7a-3845-4a78-849a-e3455cd4017e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.080250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397fced-27b1-4257-a362-6f4551675c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.080926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397fced-27b1-4257-a362-6f4551675c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.081222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397fced-27b1-4257-a362-6f4551675c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.081502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397fced-27b1-4257-a362-6f4551675c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.082226 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397fced-27b1-4257-a362-6f4551675c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.084390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397fced-27b1-4257-a362-6f4551675c29 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.085539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76889b42-5382-479d-8f00-b3b2ebb01e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.086422 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76889b42-5382-479d-8f00-b3b2ebb01e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.086701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76889b42-5382-479d-8f00-b3b2ebb01e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.086973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76889b42-5382-479d-8f00-b3b2ebb01e74 admin admin] PATH_INFO: `/v3/projects/74b68f1457ba42538df8576c0a0e85ed/users/49c56e649fb14a3caf3f2257f6023de1/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.101306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76889b42-5382-479d-8f00-b3b2ebb01e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b68f1457ba42538df8576c0a0e85ed, user_id=49c56e649fb14a3caf3f2257f6023de1, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.104008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76889b42-5382-479d-8f00-b3b2ebb01e74 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.111072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 789/1573] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:24:50 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:50.114417 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397fced-27b1-4257-a362-6f4551675c29 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.118764 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 785/1574] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:50 2022] PUT /identity/v3/projects/74b68f1457ba42538df8576c0a0e85ed/users/49c56e649fb14a3caf3f2257f6023de1/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:50.119880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76889b42-5382-479d-8f00-b3b2ebb01e74 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.182562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397fced-27b1-4257-a362-6f4551675c29 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.184497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76889b42-5382-479d-8f00-b3b2ebb01e74 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.187492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68644f41-c88b-4e64-831b-d3977914a38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.188190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68644f41-c88b-4e64-831b-d3977914a38e admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.188476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68644f41-c88b-4e64-831b-d3977914a38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.188754 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68644f41-c88b-4e64-831b-d3977914a38e admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.189259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1eb5be-5612-4799-b719-95629df3b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.189468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68644f41-c88b-4e64-831b-d3977914a38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.190152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1eb5be-5612-4799-b719-95629df3b698 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.190443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1eb5be-5612-4799-b719-95629df3b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.190727 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1eb5be-5612-4799-b719-95629df3b698 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.191336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68644f41-c88b-4e64-831b-d3977914a38e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.191433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1eb5be-5612-4799-b719-95629df3b698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.193339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1eb5be-5612-4799-b719-95629df3b698 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.211381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 790/1575] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:24:50 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:50.212194 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68644f41-c88b-4e64-831b-d3977914a38e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.219912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 786/1576] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:24:50 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:50.221045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1eb5be-5612-4799-b719-95629df3b698 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.224241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68644f41-c88b-4e64-831b-d3977914a38e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.281543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd57434-50b0-4496-bdf9-2f8c2d14f937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.282219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd57434-50b0-4496-bdf9-2f8c2d14f937 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.282514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd57434-50b0-4496-bdf9-2f8c2d14f937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.282795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd57434-50b0-4496-bdf9-2f8c2d14f937 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.283480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd57434-50b0-4496-bdf9-2f8c2d14f937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.284820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1eb5be-5612-4799-b719-95629df3b698 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.285446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd57434-50b0-4496-bdf9-2f8c2d14f937 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.289434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d91e8c-2f7a-40b5-b6fd-bcbddbb6fb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.290091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d91e8c-2f7a-40b5-b6fd-bcbddbb6fb2d admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.290381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d91e8c-2f7a-40b5-b6fd-bcbddbb6fb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.290663 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d91e8c-2f7a-40b5-b6fd-bcbddbb6fb2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.291350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d91e8c-2f7a-40b5-b6fd-bcbddbb6fb2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.293289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d91e8c-2f7a-40b5-b6fd-bcbddbb6fb2d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.308987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 791/1577] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:24:50 2022] POST /identity/v3/users => generated 278 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:50.308987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd57434-50b0-4496-bdf9-2f8c2d14f937 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.316240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd57434-50b0-4496-bdf9-2f8c2d14f937 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.321568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78429a3-6efa-45bf-8f9c-dbf4cb55c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.322257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78429a3-6efa-45bf-8f9c-dbf4cb55c6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.322548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78429a3-6efa-45bf-8f9c-dbf4cb55c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.322835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78429a3-6efa-45bf-8f9c-dbf4cb55c6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.323560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78429a3-6efa-45bf-8f9c-dbf4cb55c6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.323756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 787/1578] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:24:50 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:50.324608 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d91e8c-2f7a-40b5-b6fd-bcbddbb6fb2d admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.325483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78429a3-6efa-45bf-8f9c-dbf4cb55c6ec admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.336827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 792/1579] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.337642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78429a3-6efa-45bf-8f9c-dbf4cb55c6ec admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.347919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78429a3-6efa-45bf-8f9c-dbf4cb55c6ec admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.359287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:50.376852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:50.391130 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d91e8c-2f7a-40b5-b6fd-bcbddbb6fb2d admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.395715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c6d47-59bc-4985-864d-0c06393f485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.396420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c6d47-59bc-4985-864d-0c06393f485e admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.396709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c6d47-59bc-4985-864d-0c06393f485e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.396987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c6d47-59bc-4985-864d-0c06393f485e admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.397677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c6d47-59bc-4985-864d-0c06393f485e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.398692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: WARNING py.warnings [None req-4f9c6d47-59bc-4985-864d-0c06393f485e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:24:50.398692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: warnings.warn(msg) Jun 16 00:24:50.398692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: Jun 16 00:24:50.399908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c6d47-59bc-4985-864d-0c06393f485e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.405917 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2558800-1969-420e-ad48-f9fabe5ba878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.406692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2558800-1969-420e-ad48-f9fabe5ba878 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.407099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2558800-1969-420e-ad48-f9fabe5ba878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.407380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2558800-1969-420e-ad48-f9fabe5ba878 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.408114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2558800-1969-420e-ad48-f9fabe5ba878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.410265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2558800-1969-420e-ad48-f9fabe5ba878 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.419418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 788/1580] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:24:50 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:50.420859 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2efd2-d7af-432e-81b7-7e155e85dbf5 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.421250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2efd2-d7af-432e-81b7-7e155e85dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.421601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2efd2-d7af-432e-81b7-7e155e85dbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.435743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 793/1581] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:24:50 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:50.436890 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2558800-1969-420e-ad48-f9fabe5ba878 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.440978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-84f2efd2-d7af-432e-81b7-7e155e85dbf5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:50.442211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-84f2efd2-d7af-432e-81b7-7e155e85dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:50.447351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2558800-1969-420e-ad48-f9fabe5ba878 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.453910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 789/1582] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:50.453910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2efd2-d7af-432e-81b7-7e155e85dbf5 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.457469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ce07d-be95-4f86-bb9b-49e3329f802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.458281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ce07d-be95-4f86-bb9b-49e3329f802c admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.458561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ce07d-be95-4f86-bb9b-49e3329f802c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.458844 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ce07d-be95-4f86-bb9b-49e3329f802c admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.460005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ce07d-be95-4f86-bb9b-49e3329f802c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.461637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ce07d-be95-4f86-bb9b-49e3329f802c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.463868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2efd2-d7af-432e-81b7-7e155e85dbf5 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.469070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27501ec-7b9d-4120-ab5a-133c988ca934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.469737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27501ec-7b9d-4120-ab5a-133c988ca934 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.470019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27501ec-7b9d-4120-ab5a-133c988ca934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.470301 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27501ec-7b9d-4120-ab5a-133c988ca934 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.470988 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27501ec-7b9d-4120-ab5a-133c988ca934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.472909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27501ec-7b9d-4120-ab5a-133c988ca934 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.476345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 794/1583] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.476345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ce07d-be95-4f86-bb9b-49e3329f802c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.487075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ce07d-be95-4f86-bb9b-49e3329f802c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.492549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba658b01-f515-4d00-aff2-d21d2c43503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.493354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba658b01-f515-4d00-aff2-d21d2c43503b admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.493748 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba658b01-f515-4d00-aff2-d21d2c43503b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.494137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba658b01-f515-4d00-aff2-d21d2c43503b admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.498216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 790/1584] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:24:50 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:50.498378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba658b01-f515-4d00-aff2-d21d2c43503b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.498480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27501ec-7b9d-4120-ab5a-133c988ca934 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.498577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba658b01-f515-4d00-aff2-d21d2c43503b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.510808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 795/1585] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.510808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba658b01-f515-4d00-aff2-d21d2c43503b admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.511486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27501ec-7b9d-4120-ab5a-133c988ca934 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.517224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3daec-cde6-4c6c-83eb-a7ec86adbe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.517820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3daec-cde6-4c6c-83eb-a7ec86adbe9d admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.518406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3daec-cde6-4c6c-83eb-a7ec86adbe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.518406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3daec-cde6-4c6c-83eb-a7ec86adbe9d admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.519080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3daec-cde6-4c6c-83eb-a7ec86adbe9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.520087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba658b01-f515-4d00-aff2-d21d2c43503b admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.521031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3daec-cde6-4c6c-83eb-a7ec86adbe9d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.525577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a4728-2c89-4ef8-82b7-458231a64d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.526384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a4728-2c89-4ef8-82b7-458231a64d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.526836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a4728-2c89-4ef8-82b7-458231a64d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.527269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a4728-2c89-4ef8-82b7-458231a64d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.528132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a4728-2c89-4ef8-82b7-458231a64d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.530590 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a4728-2c89-4ef8-82b7-458231a64d28 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.541933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 791/1586] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:24:50 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:50.542843 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 796/1587] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.545083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a4728-2c89-4ef8-82b7-458231a64d28 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.545363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3daec-cde6-4c6c-83eb-a7ec86adbe9d admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.555158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3daec-cde6-4c6c-83eb-a7ec86adbe9d admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.555393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a4728-2c89-4ef8-82b7-458231a64d28 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.559610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb0ccc-aa83-48bc-9005-7c81a7fe98ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.559919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cec7cd-c05f-489d-9038-cc8fde18291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.560315 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb0ccc-aa83-48bc-9005-7c81a7fe98ee admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.560599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb0ccc-aa83-48bc-9005-7c81a7fe98ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.560698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cec7cd-c05f-489d-9038-cc8fde18291a admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.560875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb0ccc-aa83-48bc-9005-7c81a7fe98ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.560987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cec7cd-c05f-489d-9038-cc8fde18291a admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.561210 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cec7cd-c05f-489d-9038-cc8fde18291a admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.561590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb0ccc-aa83-48bc-9005-7c81a7fe98ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.561931 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cec7cd-c05f-489d-9038-cc8fde18291a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.563170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb0ccc-aa83-48bc-9005-7c81a7fe98ee admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.563558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cec7cd-c05f-489d-9038-cc8fde18291a admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.577298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 792/1588] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.577487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 797/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.577587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb0ccc-aa83-48bc-9005-7c81a7fe98ee admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.577680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cec7cd-c05f-489d-9038-cc8fde18291a admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.584258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cec7cd-c05f-489d-9038-cc8fde18291a admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.589047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e4cff-cc0f-44ee-bf57-56161ec2589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.589699 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4cff-cc0f-44ee-bf57-56161ec2589c admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.589994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4cff-cc0f-44ee-bf57-56161ec2589c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.590277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e4cff-cc0f-44ee-bf57-56161ec2589c admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.591032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e4cff-cc0f-44ee-bf57-56161ec2589c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.593309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e4cff-cc0f-44ee-bf57-56161ec2589c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.603498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 798/1590] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.604326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e4cff-cc0f-44ee-bf57-56161ec2589c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.613731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e4cff-cc0f-44ee-bf57-56161ec2589c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.618267 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea5dfe-e701-46bb-9995-09c9fb8acda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.618904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea5dfe-e701-46bb-9995-09c9fb8acda8 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.619197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea5dfe-e701-46bb-9995-09c9fb8acda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.619482 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea5dfe-e701-46bb-9995-09c9fb8acda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.620222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea5dfe-e701-46bb-9995-09c9fb8acda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.621795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea5dfe-e701-46bb-9995-09c9fb8acda8 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.632300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 799/1591] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.633148 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea5dfe-e701-46bb-9995-09c9fb8acda8 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.633959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb0ccc-aa83-48bc-9005-7c81a7fe98ee admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.637680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3a8fd-ed0d-4d63-aa9c-c693a0255e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.638953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3a8fd-ed0d-4d63-aa9c-c693a0255e84 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.639243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3a8fd-ed0d-4d63-aa9c-c693a0255e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.639526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3a8fd-ed0d-4d63-aa9c-c693a0255e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.644842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea5dfe-e701-46bb-9995-09c9fb8acda8 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.648914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3a8fd-ed0d-4d63-aa9c-c693a0255e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.649409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495deeee-83ad-4177-8295-0507893fb05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.650044 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495deeee-83ad-4177-8295-0507893fb05d admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.650333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495deeee-83ad-4177-8295-0507893fb05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.650440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3a8fd-ed0d-4d63-aa9c-c693a0255e84 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.650611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495deeee-83ad-4177-8295-0507893fb05d admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.651322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495deeee-83ad-4177-8295-0507893fb05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.652981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495deeee-83ad-4177-8295-0507893fb05d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.660183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 793/1592] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:50.660994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3a8fd-ed0d-4d63-aa9c-c693a0255e84 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.666091 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 800/1593] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.666091 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495deeee-83ad-4177-8295-0507893fb05d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.671594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3a8fd-ed0d-4d63-aa9c-c693a0255e84 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.675761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495deeee-83ad-4177-8295-0507893fb05d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.677227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc20c-7b50-4866-b4a6-a33bfbc07c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.677901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc20c-7b50-4866-b4a6-a33bfbc07c1f admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.678191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc20c-7b50-4866-b4a6-a33bfbc07c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.678471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc20c-7b50-4866-b4a6-a33bfbc07c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.679194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddc20c-7b50-4866-b4a6-a33bfbc07c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.680832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddc20c-7b50-4866-b4a6-a33bfbc07c1f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.681265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d056b62-3dac-497e-8e06-3f88ddff84b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.682229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d056b62-3dac-497e-8e06-3f88ddff84b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.682624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d056b62-3dac-497e-8e06-3f88ddff84b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.683037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d056b62-3dac-497e-8e06-3f88ddff84b9 admin admin] PATH_INFO: `/v3/projects/58f2919b24ce473d9bdc1a4dc8ffbc60/users/3c71fc14b7274f78b8f531ac158ee2e4/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.693147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 794/1594] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.694055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc20c-7b50-4866-b4a6-a33bfbc07c1f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.703995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d056b62-3dac-497e-8e06-3f88ddff84b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f2919b24ce473d9bdc1a4dc8ffbc60, user_id=3c71fc14b7274f78b8f531ac158ee2e4, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.705121 dv-cinder-845990-2-smb devstack@keystone.service[81055]: WARNING py.warnings [None req-7d056b62-3dac-497e-8e06-3f88ddff84b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:24:50.705121 dv-cinder-845990-2-smb devstack@keystone.service[81055]: warnings.warn(msg) Jun 16 00:24:50.705121 dv-cinder-845990-2-smb devstack@keystone.service[81055]: Jun 16 00:24:50.706729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc20c-7b50-4866-b4a6-a33bfbc07c1f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.707374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d056b62-3dac-497e-8e06-3f88ddff84b9 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.712428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161da87a-8fa1-4ef4-bd73-b0ec68c157a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.713102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161da87a-8fa1-4ef4-bd73-b0ec68c157a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.713429 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161da87a-8fa1-4ef4-bd73-b0ec68c157a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.713744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161da87a-8fa1-4ef4-bd73-b0ec68c157a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.714424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161da87a-8fa1-4ef4-bd73-b0ec68c157a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.716151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161da87a-8fa1-4ef4-bd73-b0ec68c157a4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.723218 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 801/1595] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:50 2022] PUT /identity/v3/projects/58f2919b24ce473d9bdc1a4dc8ffbc60/users/3c71fc14b7274f78b8f531ac158ee2e4/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:50.731660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d056b62-3dac-497e-8e06-3f88ddff84b9 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.735419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 795/1596] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.736276 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161da87a-8fa1-4ef4-bd73-b0ec68c157a4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.747359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161da87a-8fa1-4ef4-bd73-b0ec68c157a4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.814039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d056b62-3dac-497e-8e06-3f88ddff84b9 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.820145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d444f-708b-49e9-8ab2-daee42bd4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.820841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d444f-708b-49e9-8ab2-daee42bd4708 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.821136 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d444f-708b-49e9-8ab2-daee42bd4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.821412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d444f-708b-49e9-8ab2-daee42bd4708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.822496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d444f-708b-49e9-8ab2-daee42bd4708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.824257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d444f-708b-49e9-8ab2-daee42bd4708 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.828129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f1adb-7fea-48a6-906d-b272036964db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.829625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1adb-7fea-48a6-906d-b272036964db admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.829917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1adb-7fea-48a6-906d-b272036964db admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.830222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f1adb-7fea-48a6-906d-b272036964db admin admin] PATH_INFO: `/v3/projects/10f49f238af64943af0b38fbac6a131e/users/8628dfd28dd641f88a53e9ff0da20d90/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.831589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:50.841674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 802/1597] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.841674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d444f-708b-49e9-8ab2-daee42bd4708 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.843345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:50.847210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f1adb-7fea-48a6-906d-b272036964db admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f49f238af64943af0b38fbac6a131e, user_id=8628dfd28dd641f88a53e9ff0da20d90, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.851196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f1adb-7fea-48a6-906d-b272036964db admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.854289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d444f-708b-49e9-8ab2-daee42bd4708 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.860312 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c3077-b887-4a1a-a841-505f9ad2ef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.860994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3077-b887-4a1a-a841-505f9ad2ef45 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.861282 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3077-b887-4a1a-a841-505f9ad2ef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.861567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3077-b887-4a1a-a841-505f9ad2ef45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.862326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c3077-b887-4a1a-a841-505f9ad2ef45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.864157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c3077-b887-4a1a-a841-505f9ad2ef45 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.866486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 796/1598] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:50 2022] PUT /identity/v3/projects/10f49f238af64943af0b38fbac6a131e/users/8628dfd28dd641f88a53e9ff0da20d90/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:50.867446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f1adb-7fea-48a6-906d-b272036964db admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.881804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 803/1599] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.882335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c3077-b887-4a1a-a841-505f9ad2ef45 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:50.894556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c3077-b887-4a1a-a841-505f9ad2ef45 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.957755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e5ccc-5dd9-44e0-afc8-57675f066cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.959168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5ccc-5dd9-44e0-afc8-57675f066cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.959462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5ccc-5dd9-44e0-afc8-57675f066cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.959740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e5ccc-5dd9-44e0-afc8-57675f066cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.959863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f1adb-7fea-48a6-906d-b272036964db admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:50.960632 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e5ccc-5dd9-44e0-afc8-57675f066cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.962236 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e5ccc-5dd9-44e0-afc8-57675f066cd5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:50.965786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4959b-d78e-477a-a82a-9eacaa5900e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:50.966954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4959b-d78e-477a-a82a-9eacaa5900e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.967483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4959b-d78e-477a-a82a-9eacaa5900e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.967778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4959b-d78e-477a-a82a-9eacaa5900e1 admin admin] PATH_INFO: `/v3/projects/af8d71de774d4918aa91da3437f9a89a/users/7f87788cc90e46e5a677376c61a4447b/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.972565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 804/1600] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:50.973784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2d0b-929c-4901-8105-616de5d3cf9f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:50.974080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2d0b-929c-4901-8105-616de5d3cf9f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:50.974693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2d0b-929c-4901-8105-616de5d3cf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:50.989904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4959b-d78e-477a-a82a-9eacaa5900e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8d71de774d4918aa91da3437f9a89a, user_id=7f87788cc90e46e5a677376c61a4447b, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:50.993176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4959b-d78e-477a-a82a-9eacaa5900e1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:51.008116 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b8bb2d0b-929c-4901-8105-616de5d3cf9f None None] MFA Rules not processed for user `3c71fc14b7274f78b8f531ac158ee2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:51.009389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b8bb2d0b-929c-4901-8105-616de5d3cf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:51.029395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 797/1601] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:50 2022] PUT /identity/v3/projects/af8d71de774d4918aa91da3437f9a89a/users/7f87788cc90e46e5a677376c61a4447b/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:51.031174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4959b-d78e-477a-a82a-9eacaa5900e1 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:51.091612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 805/1602] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:51.097444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb2d0b-929c-4901-8105-616de5d3cf9f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:51.111528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb2d0b-929c-4901-8105-616de5d3cf9f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:51.114180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4959b-d78e-477a-a82a-9eacaa5900e1 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:51.117217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21b5f0-3725-4ed4-9869-06657d47ae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:51.118189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21b5f0-3725-4ed4-9869-06657d47ae91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.118474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21b5f0-3725-4ed4-9869-06657d47ae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.118755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21b5f0-3725-4ed4-9869-06657d47ae91 admin admin] PATH_INFO: `/v3/projects/82f885e8dea74a3a9ef30ea83b854609/users/f8dd78b473fc4b2bbe3d85471419f594/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.120210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bafd69-249a-459c-bfc2-3fc9a5858bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:51.121250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bafd69-249a-459c-bfc2-3fc9a5858bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.121984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bafd69-249a-459c-bfc2-3fc9a5858bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.122372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bafd69-249a-459c-bfc2-3fc9a5858bbd admin admin] PATH_INFO: `/v3/projects/d14eaad6a45d413a8c5438df8b4c921f/users/132e5a298e7b441db3e6b56559a564e5/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.138067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21b5f0-3725-4ed4-9869-06657d47ae91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f885e8dea74a3a9ef30ea83b854609, user_id=f8dd78b473fc4b2bbe3d85471419f594, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:51.141039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21b5f0-3725-4ed4-9869-06657d47ae91 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:51.144726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bafd69-249a-459c-bfc2-3fc9a5858bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14eaad6a45d413a8c5438df8b4c921f, user_id=132e5a298e7b441db3e6b56559a564e5, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:51.148080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bafd69-249a-459c-bfc2-3fc9a5858bbd admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:51.161792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 806/1603] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:51 2022] PUT /identity/v3/projects/82f885e8dea74a3a9ef30ea83b854609/users/f8dd78b473fc4b2bbe3d85471419f594/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:51.163175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef1a56-5699-4896-a325-3e75f434e09a None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.163487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef1a56-5699-4896-a325-3e75f434e09a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.163758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef1a56-5699-4896-a325-3e75f434e09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.168408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 798/1604] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:51 2022] PUT /identity/v3/projects/d14eaad6a45d413a8c5438df8b4c921f/users/132e5a298e7b441db3e6b56559a564e5/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:51.169229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bafd69-249a-459c-bfc2-3fc9a5858bbd admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:51.181360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-3cef1a56-5699-4896-a325-3e75f434e09a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:51.183318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3cef1a56-5699-4896-a325-3e75f434e09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:51.233622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:51.244133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:51.248942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bafd69-249a-459c-bfc2-3fc9a5858bbd admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:51.255848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 807/1605] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:51.257043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef1a56-5699-4896-a325-3e75f434e09a None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:51.262244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d269824-4ae3-4ba8-b8ee-aa35abd89130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:51.263346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269824-4ae3-4ba8-b8ee-aa35abd89130 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.263641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269824-4ae3-4ba8-b8ee-aa35abd89130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.263933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269824-4ae3-4ba8-b8ee-aa35abd89130 admin admin] PATH_INFO: `/v3/projects/df590b79c53a4e74b47e8b821b8a3ea3/users/fbc6b66ed796481abf4fdea66692f4a8/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.268710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef1a56-5699-4896-a325-3e75f434e09a None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:51.273913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bd081-cf78-479b-b3aa-e29ac3f309b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:51.274815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bd081-cf78-479b-b3aa-e29ac3f309b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.275296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bd081-cf78-479b-b3aa-e29ac3f309b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.275665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bd081-cf78-479b-b3aa-e29ac3f309b2 admin admin] PATH_INFO: `/v3/projects/834a8fb1b8d349fcb961857368bec767/users/71cddd4efaaf4298934a4f601d746175/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.279880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d269824-4ae3-4ba8-b8ee-aa35abd89130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df590b79c53a4e74b47e8b821b8a3ea3, user_id=fbc6b66ed796481abf4fdea66692f4a8, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:51.283824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d269824-4ae3-4ba8-b8ee-aa35abd89130 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:51.292563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bd081-cf78-479b-b3aa-e29ac3f309b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=834a8fb1b8d349fcb961857368bec767, user_id=71cddd4efaaf4298934a4f601d746175, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:51.295801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bd081-cf78-479b-b3aa-e29ac3f309b2 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:51.299933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 799/1606] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:51 2022] PUT /identity/v3/projects/df590b79c53a4e74b47e8b821b8a3ea3/users/fbc6b66ed796481abf4fdea66692f4a8/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:51.301244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb1a85-ac97-4af9-92af-770ea687bacd None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.301544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb1a85-ac97-4af9-92af-770ea687bacd None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.301918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb1a85-ac97-4af9-92af-770ea687bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.317359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 808/1607] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:51 2022] PUT /identity/v3/projects/834a8fb1b8d349fcb961857368bec767/users/71cddd4efaaf4298934a4f601d746175/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:51.317359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dcdee-1eec-4f28-b35b-d6b2fa86a4a7 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.317359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dcdee-1eec-4f28-b35b-d6b2fa86a4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.317359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dcdee-1eec-4f28-b35b-d6b2fa86a4a7 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.319866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 809/1608] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jun 16 00:24:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:51.320816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21882413-4c33-4b32-bea3-e37b37eb4e2f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.321226 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21882413-4c33-4b32-bea3-e37b37eb4e2f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.321858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21882413-4c33-4b32-bea3-e37b37eb4e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.333719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-04eb1a85-ac97-4af9-92af-770ea687bacd None None] MFA Rules not processed for user `7f87788cc90e46e5a677376c61a4447b`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:51.335244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-04eb1a85-ac97-4af9-92af-770ea687bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:51.344892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-21882413-4c33-4b32-bea3-e37b37eb4e2f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:51.346843 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-21882413-4c33-4b32-bea3-e37b37eb4e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:51.428489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 800/1609] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:51 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:51.428489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929fde5-96d3-4883-96c3-8bafb16dddf5 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.428489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929fde5-96d3-4883-96c3-8bafb16dddf5 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.428489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929fde5-96d3-4883-96c3-8bafb16dddf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.449386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 810/1610] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:51.451902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21882413-4c33-4b32-bea3-e37b37eb4e2f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:51.480402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2929fde5-96d3-4883-96c3-8bafb16dddf5 None None] MFA Rules not processed for user `132e5a298e7b441db3e6b56559a564e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:51.481646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2929fde5-96d3-4883-96c3-8bafb16dddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:51.543160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21882413-4c33-4b32-bea3-e37b37eb4e2f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:51.548266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f28310-5f23-4ef9-821d-27c7b8a2f7f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:51.549098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f28310-5f23-4ef9-821d-27c7b8a2f7f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.549469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f28310-5f23-4ef9-821d-27c7b8a2f7f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.552816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f28310-5f23-4ef9-821d-27c7b8a2f7f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.568930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f28310-5f23-4ef9-821d-27c7b8a2f7f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:51.570503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f28310-5f23-4ef9-821d-27c7b8a2f7f6 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:51.574248 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 801/1611] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:51.576094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80035f69-5c5d-4567-957d-e6e348dcb4a3 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.576452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80035f69-5c5d-4567-957d-e6e348dcb4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.576742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80035f69-5c5d-4567-957d-e6e348dcb4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.589207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 811/1612] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:51.594757 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b8003-c73d-4c87-9489-5ad71110b856 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.595060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b8003-c73d-4c87-9489-5ad71110b856 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.595488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b8003-c73d-4c87-9489-5ad71110b856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.603570 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-80035f69-5c5d-4567-957d-e6e348dcb4a3 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:51.605976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-80035f69-5c5d-4567-957d-e6e348dcb4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:51.619312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 802/1613] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:51.619312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081697a8-e58f-47f0-8682-9a19516a2731 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.619312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081697a8-e58f-47f0-8682-9a19516a2731 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.619312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081697a8-e58f-47f0-8682-9a19516a2731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.625506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-792b8003-c73d-4c87-9489-5ad71110b856 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:51.626763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-792b8003-c73d-4c87-9489-5ad71110b856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:51.637402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 812/1614] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:51.638548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b8003-c73d-4c87-9489-5ad71110b856 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:51.653249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b8003-c73d-4c87-9489-5ad71110b856 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:51.655477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-081697a8-e58f-47f0-8682-9a19516a2731 None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:51.657255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-081697a8-e58f-47f0-8682-9a19516a2731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:51.661698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fee41-f24a-423b-8bad-fac8f822d636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:51.662853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fee41-f24a-423b-8bad-fac8f822d636 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.663431 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fee41-f24a-423b-8bad-fac8f822d636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.665834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fee41-f24a-423b-8bad-fac8f822d636 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.667113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fee41-f24a-423b-8bad-fac8f822d636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:51.670584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fee41-f24a-423b-8bad-fac8f822d636 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:51.706630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 813/1615] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:24:51 2022] POST /identity/v3/projects => generated 355 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:51.710862 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fee41-f24a-423b-8bad-fac8f822d636 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:51.729170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:51.761188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 803/1616] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jun 16 00:24:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:51.762389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081697a8-e58f-47f0-8682-9a19516a2731 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:51.772340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:51.776898 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081697a8-e58f-47f0-8682-9a19516a2731 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:51.784886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fee41-f24a-423b-8bad-fac8f822d636 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:51.790120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1fce1-bc59-4431-870b-1e63e465bf75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:51.790804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fce1-bc59-4431-870b-1e63e465bf75 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.791099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fce1-bc59-4431-870b-1e63e465bf75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.791382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fce1-bc59-4431-870b-1e63e465bf75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.871696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1fce1-bc59-4431-870b-1e63e465bf75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:51.873741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1fce1-bc59-4431-870b-1e63e465bf75 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:51.876966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569da1eb-9655-4110-aca4-2834a2224430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:51.878195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569da1eb-9655-4110-aca4-2834a2224430 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:51.878724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569da1eb-9655-4110-aca4-2834a2224430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:51.880024 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569da1eb-9655-4110-aca4-2834a2224430 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:51.881287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569da1eb-9655-4110-aca4-2834a2224430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:51.883592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569da1eb-9655-4110-aca4-2834a2224430 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:51.895954 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 814/1617] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:51.897388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1fce1-bc59-4431-870b-1e63e465bf75 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:51.920097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1fce1-bc59-4431-870b-1e63e465bf75 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:51.923689 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 804/1618] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:24:51 2022] POST /identity/v3/projects => generated 403 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:51.926322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569da1eb-9655-4110-aca4-2834a2224430 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.043190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569da1eb-9655-4110-aca4-2834a2224430 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:52.045477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa0d18-b308-4ae8-a166-7da1ff9a1c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.046153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa0d18-b308-4ae8-a166-7da1ff9a1c50 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.046435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa0d18-b308-4ae8-a166-7da1ff9a1c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.046712 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa0d18-b308-4ae8-a166-7da1ff9a1c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.051696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db377f1-8dd8-45ab-9d79-0376bd4aaa42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.052421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db377f1-8dd8-45ab-9d79-0376bd4aaa42 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.052714 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db377f1-8dd8-45ab-9d79-0376bd4aaa42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.053017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db377f1-8dd8-45ab-9d79-0376bd4aaa42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.133372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa0d18-b308-4ae8-a166-7da1ff9a1c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.137839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa0d18-b308-4ae8-a166-7da1ff9a1c50 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.174826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db377f1-8dd8-45ab-9d79-0376bd4aaa42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.176716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 815/1619] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:52.176884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db377f1-8dd8-45ab-9d79-0376bd4aaa42 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.178962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa0d18-b308-4ae8-a166-7da1ff9a1c50 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.190868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa0d18-b308-4ae8-a166-7da1ff9a1c50 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:52.196729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daea23-2e2f-4557-ae96-b4bbf30b066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.197574 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daea23-2e2f-4557-ae96-b4bbf30b066d admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.197911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 805/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:52.198173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daea23-2e2f-4557-ae96-b4bbf30b066d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.198528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59daea23-2e2f-4557-ae96-b4bbf30b066d admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.198839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db377f1-8dd8-45ab-9d79-0376bd4aaa42 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.199535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59daea23-2e2f-4557-ae96-b4bbf30b066d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.202157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59daea23-2e2f-4557-ae96-b4bbf30b066d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.240375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 816/1621] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:24:52 2022] POST /identity/v3/users => generated 284 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:52.241224 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daea23-2e2f-4557-ae96-b4bbf30b066d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.253037 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:52.269707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59daea23-2e2f-4557-ae96-b4bbf30b066d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:52.275303 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331b78f-9b2f-4a45-8eb5-17dab27e18bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.276016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331b78f-9b2f-4a45-8eb5-17dab27e18bc admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.276309 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331b78f-9b2f-4a45-8eb5-17dab27e18bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.276604 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331b78f-9b2f-4a45-8eb5-17dab27e18bc admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.277296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331b78f-9b2f-4a45-8eb5-17dab27e18bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.290686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331b78f-9b2f-4a45-8eb5-17dab27e18bc admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.318728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 817/1622] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:24:52 2022] POST /identity/v3/users => generated 308 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:24:52.318728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331b78f-9b2f-4a45-8eb5-17dab27e18bc admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.333504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db377f1-8dd8-45ab-9d79-0376bd4aaa42 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:52.340761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a825c-8259-4d6e-8578-7860e7ca163e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.341986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a825c-8259-4d6e-8578-7860e7ca163e service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.342274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a825c-8259-4d6e-8578-7860e7ca163e service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.342557 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a825c-8259-4d6e-8578-7860e7ca163e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.342740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331b78f-9b2f-4a45-8eb5-17dab27e18bc admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:52.358238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5d6db-6698-4ee5-aa0d-bb44cdc7d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.358941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5d6db-6698-4ee5-aa0d-bb44cdc7d753 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.360906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5d6db-6698-4ee5-aa0d-bb44cdc7d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.361365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5d6db-6698-4ee5-aa0d-bb44cdc7d753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.363831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5d6db-6698-4ee5-aa0d-bb44cdc7d753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.365520 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5d6db-6698-4ee5-aa0d-bb44cdc7d753 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.375254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:52.414394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a825c-8259-4d6e-8578-7860e7ca163e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.416275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a825c-8259-4d6e-8578-7860e7ca163e service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.426254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 818/1623] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:52.427913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5d6db-6698-4ee5-aa0d-bb44cdc7d753 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.432674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 806/1624] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:52.433530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a825c-8259-4d6e-8578-7860e7ca163e service nova] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.441880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5d6db-6698-4ee5-aa0d-bb44cdc7d753 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:52.445529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a825c-8259-4d6e-8578-7860e7ca163e service nova] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:52.447767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34b8aa-7a16-42be-adc8-d2026ac17924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.448530 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34b8aa-7a16-42be-adc8-d2026ac17924 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.449064 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34b8aa-7a16-42be-adc8-d2026ac17924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.449302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34b8aa-7a16-42be-adc8-d2026ac17924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.450397 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c6d68-bf4b-4151-bdc8-dd06af83e6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.450661 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34b8aa-7a16-42be-adc8-d2026ac17924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.452948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6d68-bf4b-4151-bdc8-dd06af83e6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.452948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6d68-bf4b-4151-bdc8-dd06af83e6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.453226 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6d68-bf4b-4151-bdc8-dd06af83e6fd admin admin] PATH_INFO: `/v3/projects/c2eb5d07dc0146a2b68fb82a7dd5ed40/users/fd9895e05f5b404e8af94418d6dd9afa/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.453872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34b8aa-7a16-42be-adc8-d2026ac17924 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.471268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c6d68-bf4b-4151-bdc8-dd06af83e6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2eb5d07dc0146a2b68fb82a7dd5ed40, user_id=fd9895e05f5b404e8af94418d6dd9afa, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.474200 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c6d68-bf4b-4151-bdc8-dd06af83e6fd admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.492510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 807/1625] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:52 2022] PUT /identity/v3/projects/c2eb5d07dc0146a2b68fb82a7dd5ed40/users/fd9895e05f5b404e8af94418d6dd9afa/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:52.499744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c6d68-bf4b-4151-bdc8-dd06af83e6fd admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.500662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 819/1626] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:24:52.502790 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34b8aa-7a16-42be-adc8-d2026ac17924 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.517283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34b8aa-7a16-42be-adc8-d2026ac17924 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:52.615100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a474a6-6e34-4ad9-a146-a958e69a0e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.616081 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a474a6-6e34-4ad9-a146-a958e69a0e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.616362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a474a6-6e34-4ad9-a146-a958e69a0e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.616650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a474a6-6e34-4ad9-a146-a958e69a0e1d admin admin] PATH_INFO: `/v3/projects/520e3412719b4e70b0978d3db0885198/users/590540aebc114b249d847708ca0312e3/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.633870 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c6d68-bf4b-4151-bdc8-dd06af83e6fd admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:52.642837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00411ee0-0cf8-4d1c-b15a-47c1d15df0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.643846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00411ee0-0cf8-4d1c-b15a-47c1d15df0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.644344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00411ee0-0cf8-4d1c-b15a-47c1d15df0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.645148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00411ee0-0cf8-4d1c-b15a-47c1d15df0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.646052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00411ee0-0cf8-4d1c-b15a-47c1d15df0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.648255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00411ee0-0cf8-4d1c-b15a-47c1d15df0f3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.661104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 808/1627] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:24:52.665148 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a474a6-6e34-4ad9-a146-a958e69a0e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=520e3412719b4e70b0978d3db0885198, user_id=590540aebc114b249d847708ca0312e3, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.665593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00411ee0-0cf8-4d1c-b15a-47c1d15df0f3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.667859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a474a6-6e34-4ad9-a146-a958e69a0e1d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.685401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00411ee0-0cf8-4d1c-b15a-47c1d15df0f3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:52.692361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 820/1628] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:52 2022] PUT /identity/v3/projects/520e3412719b4e70b0978d3db0885198/users/590540aebc114b249d847708ca0312e3/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:52.696297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a474a6-6e34-4ad9-a146-a958e69a0e1d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.845323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:52.848550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a474a6-6e34-4ad9-a146-a958e69a0e1d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:52.856696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1528098-7716-470e-9b6c-7f59c50467f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.858054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528098-7716-470e-9b6c-7f59c50467f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.858693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528098-7716-470e-9b6c-7f59c50467f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.859113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1528098-7716-470e-9b6c-7f59c50467f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.860085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1528098-7716-470e-9b6c-7f59c50467f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.861862 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1528098-7716-470e-9b6c-7f59c50467f3 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.892617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7db029-f1f0-4342-9b63-6a3526bc7da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:52.893710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db029-f1f0-4342-9b63-6a3526bc7da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.894033 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db029-f1f0-4342-9b63-6a3526bc7da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.894322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db029-f1f0-4342-9b63-6a3526bc7da2 admin admin] PATH_INFO: `/v3/projects/c2eb5d07dc0146a2b68fb82a7dd5ed40/users/fd9895e05f5b404e8af94418d6dd9afa/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.897549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 821/1629] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:24:52.901607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7db029-f1f0-4342-9b63-6a3526bc7da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2eb5d07dc0146a2b68fb82a7dd5ed40, user_id=fd9895e05f5b404e8af94418d6dd9afa, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:52.902303 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1528098-7716-470e-9b6c-7f59c50467f3 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:52.904624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7db029-f1f0-4342-9b63-6a3526bc7da2 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:52.926449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 809/1630] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:52 2022] PUT /identity/v3/projects/c2eb5d07dc0146a2b68fb82a7dd5ed40/users/fd9895e05f5b404e8af94418d6dd9afa/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:52.938854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b621e71-7c65-4f65-935c-a455eb71edd9 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:52.939145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b621e71-7c65-4f65-935c-a455eb71edd9 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:52.939431 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b621e71-7c65-4f65-935c-a455eb71edd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:52.940726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1528098-7716-470e-9b6c-7f59c50467f3 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:53.003511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-5b621e71-7c65-4f65-935c-a455eb71edd9 None None] MFA Rules not processed for user `fd9895e05f5b404e8af94418d6dd9afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:53.004778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5b621e71-7c65-4f65-935c-a455eb71edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:53.094006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69d6c9-d611-4ad4-910c-56ab0ccb6f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:53.096196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69d6c9-d611-4ad4-910c-56ab0ccb6f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:53.097206 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69d6c9-d611-4ad4-910c-56ab0ccb6f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:53.098440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69d6c9-d611-4ad4-910c-56ab0ccb6f62 admin admin] PATH_INFO: `/v3/projects/520e3412719b4e70b0978d3db0885198/users/590540aebc114b249d847708ca0312e3/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:53.101801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69d6c9-d611-4ad4-910c-56ab0ccb6f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520e3412719b4e70b0978d3db0885198, user_id=590540aebc114b249d847708ca0312e3, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:53.108516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69d6c9-d611-4ad4-910c-56ab0ccb6f62 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:53.119417 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:53.130677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 810/1631] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:52 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:24:53.132942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 822/1632] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:24:52 2022] PUT /identity/v3/projects/520e3412719b4e70b0978d3db0885198/users/590540aebc114b249d847708ca0312e3/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:53.136705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83fb6-38e4-41a1-8d2a-2a35571fe1d3 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:53.137600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83fb6-38e4-41a1-8d2a-2a35571fe1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:53.138299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b83fb6-38e4-41a1-8d2a-2a35571fe1d3 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:53.141382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 811/1633] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jun 16 00:24:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:53.149058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b83fb6-38e4-41a1-8d2a-2a35571fe1d3 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:53.152905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5ef5-80d9-463b-9183-a2747964bcb2 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:53.154407 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5ef5-80d9-463b-9183-a2747964bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:53.154915 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa5ef5-80d9-463b-9183-a2747964bcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:53.206941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6aaa5ef5-80d9-463b-9183-a2747964bcb2 None None] MFA Rules not processed for user `590540aebc114b249d847708ca0312e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:53.208859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6aaa5ef5-80d9-463b-9183-a2747964bcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:53.245245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b83fb6-38e4-41a1-8d2a-2a35571fe1d3 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:53.253073 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d063b-ae39-4597-a152-1689111bc606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:53.254375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d063b-ae39-4597-a152-1689111bc606 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:53.254783 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d063b-ae39-4597-a152-1689111bc606 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:53.255651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d063b-ae39-4597-a152-1689111bc606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:53.347635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d063b-ae39-4597-a152-1689111bc606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:53.351611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d063b-ae39-4597-a152-1689111bc606 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:53.358440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:53.375542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 812/1634] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:53 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:53.378193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60d827-2063-4e5b-9b01-013b9693971f None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:53.378947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60d827-2063-4e5b-9b01-013b9693971f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:53.379336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60d827-2063-4e5b-9b01-013b9693971f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:53.414549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0c60d827-2063-4e5b-9b01-013b9693971f None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:53.418303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0c60d827-2063-4e5b-9b01-013b9693971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:53.421596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 823/1635] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:53.442988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa5ef5-80d9-463b-9183-a2747964bcb2 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:53.461354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa5ef5-80d9-463b-9183-a2747964bcb2 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:53.467145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6788763-4a7f-413d-83ff-af0e44cdc431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:53.467831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788763-4a7f-413d-83ff-af0e44cdc431 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:53.468146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788763-4a7f-413d-83ff-af0e44cdc431 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:53.468427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788763-4a7f-413d-83ff-af0e44cdc431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:53.489996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6788763-4a7f-413d-83ff-af0e44cdc431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:53.491510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6788763-4a7f-413d-83ff-af0e44cdc431 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:53.523235 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 824/1636] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:24:53.586143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 813/1637] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:24:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:53.641142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6788763-4a7f-413d-83ff-af0e44cdc431 service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:53.651187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6788763-4a7f-413d-83ff-af0e44cdc431 service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:53.675916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58a9b4-5fd0-4ca9-8785-2a012d123fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:53.677733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a9b4-5fd0-4ca9-8785-2a012d123fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:53.678127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a9b4-5fd0-4ca9-8785-2a012d123fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:53.678487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a9b4-5fd0-4ca9-8785-2a012d123fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:53.706068 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60d827-2063-4e5b-9b01-013b9693971f None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:53.711870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58a9b4-5fd0-4ca9-8785-2a012d123fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:53.716544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58a9b4-5fd0-4ca9-8785-2a012d123fa4 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:53.720475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60d827-2063-4e5b-9b01-013b9693971f None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:53.729435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e8683-d3e9-4252-9bf9-38928f3c29c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:53.732439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e8683-d3e9-4252-9bf9-38928f3c29c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:53.733022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e8683-d3e9-4252-9bf9-38928f3c29c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:53.733472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e8683-d3e9-4252-9bf9-38928f3c29c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:53.760150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 825/1638] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:53.885594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e8683-d3e9-4252-9bf9-38928f3c29c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:53.891633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e8683-d3e9-4252-9bf9-38928f3c29c0 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:53.917519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 814/1639] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:53 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:54.650826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58a9b4-5fd0-4ca9-8785-2a012d123fa4 service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:54.804796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58a9b4-5fd0-4ca9-8785-2a012d123fa4 service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:54.814636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:54.820959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:54.823413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:54.823814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] PATH_INFO: `/v3/users/132e5a298e7b441db3e6b56559a564e5` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:54.828274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132e5a298e7b441db3e6b56559a564e5)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:54.830934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: WARNING py.warnings [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:24:54.830934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: warnings.warn(msg) Jun 16 00:24:54.830934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: Jun 16 00:24:54.833984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:54.993460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132e5a298e7b441db3e6b56559a564e5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:54.995273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132e5a298e7b441db3e6b56559a564e5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:55.065602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:55.085527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132e5a298e7b441db3e6b56559a564e5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:55.086636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132e5a298e7b441db3e6b56559a564e5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:55.106833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0163ce79-049e-411c-a5f9-1337143d2a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132e5a298e7b441db3e6b56559a564e5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:55.141520 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 826/1640] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:24:54 2022] DELETE /identity/v3/users/132e5a298e7b441db3e6b56559a564e5 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:55.145814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb3c70-e096-421e-8ce0-66b955e2055e None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:55.146354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb3c70-e096-421e-8ce0-66b955e2055e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:55.146478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb3c70-e096-421e-8ce0-66b955e2055e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:55.179248 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-adeb3c70-e096-421e-8ce0-66b955e2055e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:55.180720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-adeb3c70-e096-421e-8ce0-66b955e2055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:55.326149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 815/1641] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:55.464834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d491a-1e44-4f97-ae79-199b275a11f9 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:55.465774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d491a-1e44-4f97-ae79-199b275a11f9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:55.466375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d491a-1e44-4f97-ae79-199b275a11f9 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:55.468717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 827/1642] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jun 16 00:24:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:55.470892 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb3c70-e096-421e-8ce0-66b955e2055e None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:55.472701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-adeb3c70-e096-421e-8ce0-66b955e2055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:55.501347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34105a30-1522-4f32-bc37-df316c40d9d3 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:55.501780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34105a30-1522-4f32-bc37-df316c40d9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:55.502096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34105a30-1522-4f32-bc37-df316c40d9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:55.552330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-34105a30-1522-4f32-bc37-df316c40d9d3 None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:55.553787 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-34105a30-1522-4f32-bc37-df316c40d9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:55.571931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:55.611897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb3c70-e096-421e-8ce0-66b955e2055e None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:55.619781 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1596e-e1f1-4dca-9616-01280ec8f6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:55.620858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1596e-e1f1-4dca-9616-01280ec8f6df service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:55.621142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1596e-e1f1-4dca-9616-01280ec8f6df service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:55.623403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1596e-e1f1-4dca-9616-01280ec8f6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:55.638896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1596e-e1f1-4dca-9616-01280ec8f6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:55.641924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1596e-e1f1-4dca-9616-01280ec8f6df service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:55.662076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 816/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:55.688361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 828/1644] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jun 16 00:24:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 16 00:24:55.692544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b7574-f468-4ba7-8e2e-cb6fed8dfa71 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:55.693251 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b7574-f468-4ba7-8e2e-cb6fed8dfa71 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:55.693718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b7574-f468-4ba7-8e2e-cb6fed8dfa71 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:55.695330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 817/1645] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jun 16 00:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:55.702096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5fb24-e936-422d-90a9-f3600e4a4f14 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:55.702670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5fb24-e936-422d-90a9-f3600e4a4f14 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:55.703254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5fb24-e936-422d-90a9-f3600e4a4f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:55.723330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-8cc5fb24-e936-422d-90a9-f3600e4a4f14 None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:55.724943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-8cc5fb24-e936-422d-90a9-f3600e4a4f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:55.750697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 829/1646] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:24:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:55.760494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b7574-f468-4ba7-8e2e-cb6fed8dfa71 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:55.763715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a15b7574-f468-4ba7-8e2e-cb6fed8dfa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:55.844886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b7574-f468-4ba7-8e2e-cb6fed8dfa71 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:55.850064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5f296-c601-4c5b-a54e-9c78314ef2a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:55.850782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5f296-c601-4c5b-a54e-9c78314ef2a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:55.851350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5f296-c601-4c5b-a54e-9c78314ef2a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:55.851639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5f296-c601-4c5b-a54e-9c78314ef2a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:55.868777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5f296-c601-4c5b-a54e-9c78314ef2a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:55.871021 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5f296-c601-4c5b-a54e-9c78314ef2a1 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:55.888029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 818/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:56.373614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5fb24-e936-422d-90a9-f3600e4a4f14 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:56.375138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-8cc5fb24-e936-422d-90a9-f3600e4a4f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:56.414639 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5fb24-e936-422d-90a9-f3600e4a4f14 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:56.425320 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:56.428236 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:56.428545 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:56.428830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] PATH_INFO: `/v3/projects/d14eaad6a45d413a8c5438df8b4c921f` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:56.431735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14eaad6a45d413a8c5438df8b4c921f)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:56.437409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:56.541199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14eaad6a45d413a8c5438df8b4c921f', 'request_id': 'req-e5b2b875-0b89-49d6-b376-09dfb8462e70'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:56.567148 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14eaad6a45d413a8c5438df8b4c921f', 'request_id': 'req-e5b2b875-0b89-49d6-b376-09dfb8462e70'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:56.582059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14eaad6a45d413a8c5438df8b4c921f', 'request_id': 'req-e5b2b875-0b89-49d6-b376-09dfb8462e70'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:56.605075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] The token cache is being invalidate because project d14eaad6a45d413a8c5438df8b4c921f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:24:56.605601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:56.607157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:56.610414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 830/1648] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:24:56 2022] DELETE /identity/v3/projects/d14eaad6a45d413a8c5438df8b4c921f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:56.614872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5f296-c601-4c5b-a54e-9c78314ef2a1 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:56.629315 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5f296-c601-4c5b-a54e-9c78314ef2a1 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:56.760863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6819e-dfe8-4abe-9a09-dc3ad39f2492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:56.761964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6819e-dfe8-4abe-9a09-dc3ad39f2492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:56.763708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6819e-dfe8-4abe-9a09-dc3ad39f2492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:56.766740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6819e-dfe8-4abe-9a09-dc3ad39f2492 admin admin] PATH_INFO: `/v3/users/590540aebc114b249d847708ca0312e3` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:56.771560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6819e-dfe8-4abe-9a09-dc3ad39f2492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590540aebc114b249d847708ca0312e3)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:56.773751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6819e-dfe8-4abe-9a09-dc3ad39f2492 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:56.861452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-53f6819e-dfe8-4abe-9a09-dc3ad39f2492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590540aebc114b249d847708ca0312e3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:56.897189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-53f6819e-dfe8-4abe-9a09-dc3ad39f2492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590540aebc114b249d847708ca0312e3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:56.898114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-53f6819e-dfe8-4abe-9a09-dc3ad39f2492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590540aebc114b249d847708ca0312e3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:56.912257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-53f6819e-dfe8-4abe-9a09-dc3ad39f2492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590540aebc114b249d847708ca0312e3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:56.926933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:56.947287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-53f6819e-dfe8-4abe-9a09-dc3ad39f2492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590540aebc114b249d847708ca0312e3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:56.966488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 819/1649] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:24:56 2022] DELETE /identity/v3/users/590540aebc114b249d847708ca0312e3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:57.594347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:57.594347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:57.601763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2b875-0b89-49d6-b376-09dfb8462e70 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:57.699946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:57.761386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:57.762315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:57.762618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:57.763472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] PATH_INFO: `/v3/users/3c71fc14b7274f78b8f531ac158ee2e4` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:57.764790 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c71fc14b7274f78b8f531ac158ee2e4)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:57.766780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:57.914536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c71fc14b7274f78b8f531ac158ee2e4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:57.921900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c71fc14b7274f78b8f531ac158ee2e4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:57.955077 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c71fc14b7274f78b8f531ac158ee2e4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:57.956487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c71fc14b7274f78b8f531ac158ee2e4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:57.969661 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c71fc14b7274f78b8f531ac158ee2e4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:24:58.058651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 831/1650] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:24:57 2022] DELETE /identity/v3/users/3c71fc14b7274f78b8f531ac158ee2e4 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:24:58.064542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6707b06-e80b-4569-b4bf-29858b187a6d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:58.064982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6707b06-e80b-4569-b4bf-29858b187a6d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:58.065289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6707b06-e80b-4569-b4bf-29858b187a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:58.115667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d6707b06-e80b-4569-b4bf-29858b187a6d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:58.116977 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d6707b06-e80b-4569-b4bf-29858b187a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:58.252596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 820/1651] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:58.297408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:58.298796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:58.453429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b58e3c-fa47-4149-bef4-3d27b7695c25 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:58.458469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ce4f1-c5a1-4c40-92d8-e2924e806f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:58.459464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ce4f1-c5a1-4c40-92d8-e2924e806f67 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:58.461032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ce4f1-c5a1-4c40-92d8-e2924e806f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:58.461577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ce4f1-c5a1-4c40-92d8-e2924e806f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:58.505837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ce4f1-c5a1-4c40-92d8-e2924e806f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:58.512155 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ce4f1-c5a1-4c40-92d8-e2924e806f67 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:58.535619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 832/1652] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:59.804552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6707b06-e80b-4569-b4bf-29858b187a6d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:59.807254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d6707b06-e80b-4569-b4bf-29858b187a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:59.830067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6707b06-e80b-4569-b4bf-29858b187a6d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:59.851047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:59.853044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:59.853479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:59.854735 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] PATH_INFO: `/v3/projects/520e3412719b4e70b0978d3db0885198` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:59.857278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=520e3412719b4e70b0978d3db0885198)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:59.859887 dv-cinder-845990-2-smb devstack@keystone.service[81054]: WARNING py.warnings [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:24:59.859887 dv-cinder-845990-2-smb devstack@keystone.service[81054]: warnings.warn(msg) Jun 16 00:24:59.859887 dv-cinder-845990-2-smb devstack@keystone.service[81054]: Jun 16 00:24:59.865054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:00.010904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ce4f1-c5a1-4c40-92d8-e2924e806f67 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:00.012485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-8e3ce4f1-c5a1-4c40-92d8-e2924e806f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:00.048553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ce4f1-c5a1-4c40-92d8-e2924e806f67 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:00.048773 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520e3412719b4e70b0978d3db0885198', 'request_id': 'req-2c66d307-d022-4297-9881-06bd7c892329'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:00.068774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520e3412719b4e70b0978d3db0885198', 'request_id': 'req-2c66d307-d022-4297-9881-06bd7c892329'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:00.080970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520e3412719b4e70b0978d3db0885198', 'request_id': 'req-2c66d307-d022-4297-9881-06bd7c892329'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:00.127652 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] The token cache is being invalidate because project 520e3412719b4e70b0978d3db0885198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:00.128126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:00.129029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2c66d307-d022-4297-9881-06bd7c892329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:00.132217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 821/1653] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:24:59 2022] DELETE /identity/v3/projects/520e3412719b4e70b0978d3db0885198 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:00.136752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ce9de-9538-43be-86c2-b640d123868a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:00.137156 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ce9de-9538-43be-86c2-b640d123868a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:00.137448 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ce9de-9538-43be-86c2-b640d123868a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:00.199981 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-9d6ce9de-9538-43be-86c2-b640d123868a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:00.202243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9d6ce9de-9538-43be-86c2-b640d123868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:00.244791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:00.245764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:00.246114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:00.246628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] PATH_INFO: `/v3/projects/58f2919b24ce473d9bdc1a4dc8ffbc60` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:00.261823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f2919b24ce473d9bdc1a4dc8ffbc60)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:00.261823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:00.287888 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:00.355688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f2919b24ce473d9bdc1a4dc8ffbc60', 'request_id': 'req-0792274f-83fb-45cc-9bf9-9a63b8f27352'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:00.366478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 822/1654] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:00.368847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118d06a-6c9d-4815-be08-cc75fdbaaeb5 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:00.369268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118d06a-6c9d-4815-be08-cc75fdbaaeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:00.369661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118d06a-6c9d-4815-be08-cc75fdbaaeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:00.374340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f2919b24ce473d9bdc1a4dc8ffbc60', 'request_id': 'req-0792274f-83fb-45cc-9bf9-9a63b8f27352'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:00.381162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f2919b24ce473d9bdc1a4dc8ffbc60', 'request_id': 'req-0792274f-83fb-45cc-9bf9-9a63b8f27352'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:00.405849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-5118d06a-6c9d-4815-be08-cc75fdbaaeb5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:00.406749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5118d06a-6c9d-4815-be08-cc75fdbaaeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:00.410479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] The token cache is being invalidate because project 58f2919b24ce473d9bdc1a4dc8ffbc60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:00.410940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:00.411487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0792274f-83fb-45cc-9bf9-9a63b8f27352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:00.413432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 833/1655] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:00 2022] DELETE /identity/v3/projects/58f2919b24ce473d9bdc1a4dc8ffbc60 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:00.418352 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728146-436f-4e31-b025-519f32820c31 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:00.418352 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728146-436f-4e31-b025-519f32820c31 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:00.418670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c728146-436f-4e31-b025-519f32820c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:00.442193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:00.452185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6c728146-436f-4e31-b025-519f32820c31 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:00.453262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6c728146-436f-4e31-b025-519f32820c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:00.556095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 823/1656] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:00.568765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118d06a-6c9d-4815-be08-cc75fdbaaeb5 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:00.596434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 834/1657] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:00.597528 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118d06a-6c9d-4815-be08-cc75fdbaaeb5 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:00.610092 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2e85-8b4b-41bf-ab9a-a2951b16247d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:00.610411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2e85-8b4b-41bf-ab9a-a2951b16247d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:00.610694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a2e85-8b4b-41bf-ab9a-a2951b16247d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:00.631060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557c048-a9a5-490d-9e9a-2682c8a970ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:00.631748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557c048-a9a5-490d-9e9a-2682c8a970ce admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:00.632013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557c048-a9a5-490d-9e9a-2682c8a970ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:00.632303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557c048-a9a5-490d-9e9a-2682c8a970ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:00.633043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557c048-a9a5-490d-9e9a-2682c8a970ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:00.633356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557c048-a9a5-490d-9e9a-2682c8a970ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:00.641062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557c048-a9a5-490d-9e9a-2682c8a970ce admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:00.668431 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-5f3a2e85-8b4b-41bf-ab9a-a2951b16247d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:00.669738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 824/1658] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:25:00.671063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5f3a2e85-8b4b-41bf-ab9a-a2951b16247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:00.673311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557c048-a9a5-490d-9e9a-2682c8a970ce admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:00.691230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557c048-a9a5-490d-9e9a-2682c8a970ce admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:00.699746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 835/1659] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:00.701197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a2e85-8b4b-41bf-ab9a-a2951b16247d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:00.713428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0550d-ba31-4f9b-a1f9-df9db59a599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:00.714146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0550d-ba31-4f9b-a1f9-df9db59a599b admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:00.714419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0550d-ba31-4f9b-a1f9-df9db59a599b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:00.714697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0550d-ba31-4f9b-a1f9-df9db59a599b admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:00.715502 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0550d-ba31-4f9b-a1f9-df9db59a599b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:00.718010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0550d-ba31-4f9b-a1f9-df9db59a599b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:00.730396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a2e85-8b4b-41bf-ab9a-a2951b16247d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:00.746123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e9066-3699-47d6-bab0-537b48c747f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:00.746987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9066-3699-47d6-bab0-537b48c747f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:00.747706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9066-3699-47d6-bab0-537b48c747f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:00.748113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9066-3699-47d6-bab0-537b48c747f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:00.749038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e9066-3699-47d6-bab0-537b48c747f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:00.749369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e9066-3699-47d6-bab0-537b48c747f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:00.751017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e9066-3699-47d6-bab0-537b48c747f7 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:00.812279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 836/1660] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:00.823848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e9066-3699-47d6-bab0-537b48c747f7 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:00.863076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 825/1661] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:00 2022] POST /identity/v3/projects => generated 405 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:00.866630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e9066-3699-47d6-bab0-537b48c747f7 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:00.868566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0550d-ba31-4f9b-a1f9-df9db59a599b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:01.103781 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b33386-6d35-4320-a2d8-e08237e7edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:01.104509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33386-6d35-4320-a2d8-e08237e7edef admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:01.104806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33386-6d35-4320-a2d8-e08237e7edef admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:01.105090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33386-6d35-4320-a2d8-e08237e7edef admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:01.105796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b33386-6d35-4320-a2d8-e08237e7edef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:01.108338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b33386-6d35-4320-a2d8-e08237e7edef admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:01.117391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0550d-ba31-4f9b-a1f9-df9db59a599b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:01.142027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f680cb5-c52c-43f0-921d-8eb261dabac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:01.142753 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f680cb5-c52c-43f0-921d-8eb261dabac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:01.143043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f680cb5-c52c-43f0-921d-8eb261dabac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:01.143429 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f680cb5-c52c-43f0-921d-8eb261dabac3 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:01.146915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f680cb5-c52c-43f0-921d-8eb261dabac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:01.149075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f680cb5-c52c-43f0-921d-8eb261dabac3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:01.253930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 837/1662] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:00 2022] POST /identity/v3/projects => generated 365 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:25:01.264024 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 826/1663] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:00 2022] POST /identity/v3/users => generated 303 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:01.276042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f680cb5-c52c-43f0-921d-8eb261dabac3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:01.277256 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b33386-6d35-4320-a2d8-e08237e7edef admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:01.309848 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f680cb5-c52c-43f0-921d-8eb261dabac3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:01.319525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:01.548738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d978c-924a-41e9-adc3-7db251787d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:01.549548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d978c-924a-41e9-adc3-7db251787d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:01.552359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d978c-924a-41e9-adc3-7db251787d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:01.552853 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d978c-924a-41e9-adc3-7db251787d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:01.553829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d978c-924a-41e9-adc3-7db251787d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:01.557550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d978c-924a-41e9-adc3-7db251787d9f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:01.616098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 827/1664] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:01.622901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d978c-924a-41e9-adc3-7db251787d9f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:01.676577 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d978c-924a-41e9-adc3-7db251787d9f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:01.691818 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd0d92-257e-414a-8458-fdbe01806ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:01.692644 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd0d92-257e-414a-8458-fdbe01806ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:01.693016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd0d92-257e-414a-8458-fdbe01806ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:01.693396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd0d92-257e-414a-8458-fdbe01806ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:01.694208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd0d92-257e-414a-8458-fdbe01806ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:01.695924 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd0d92-257e-414a-8458-fdbe01806ef0 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:01.699078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:01.727829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 828/1665] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:01.730575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd0d92-257e-414a-8458-fdbe01806ef0 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:01.736702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b33386-6d35-4320-a2d8-e08237e7edef admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:01.751055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd0d92-257e-414a-8458-fdbe01806ef0 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:01.755720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceccfd1-3414-46d7-82b7-88478f1ccc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:01.761491 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceccfd1-3414-46d7-82b7-88478f1ccc2a admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:01.761869 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceccfd1-3414-46d7-82b7-88478f1ccc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:01.762440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25817546-5b18-4640-9610-9727df3fc929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:01.763123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceccfd1-3414-46d7-82b7-88478f1ccc2a admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:01.765492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817546-5b18-4640-9610-9727df3fc929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:01.765918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817546-5b18-4640-9610-9727df3fc929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:01.766721 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceccfd1-3414-46d7-82b7-88478f1ccc2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:01.767145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25817546-5b18-4640-9610-9727df3fc929 admin admin] PATH_INFO: `/v3/projects/9608be21abd04ddebd1abec8f50d2a09/users/e53d89b5cb02499f845d3364c6c54c38/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:01.777523 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceccfd1-3414-46d7-82b7-88478f1ccc2a admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:01.808014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25817546-5b18-4640-9610-9727df3fc929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9608be21abd04ddebd1abec8f50d2a09, user_id=e53d89b5cb02499f845d3364c6c54c38, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:01.815354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25817546-5b18-4640-9610-9727df3fc929 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:01.837298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 838/1666] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:01 2022] POST /identity/v3/users => generated 283 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:01.843354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceccfd1-3414-46d7-82b7-88478f1ccc2a admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:01.845771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 829/1667] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:01 2022] PUT /identity/v3/projects/9608be21abd04ddebd1abec8f50d2a09/users/e53d89b5cb02499f845d3364c6c54c38/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:01.851179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584e4a5-38e8-4da0-9df8-ec94968a0e38 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:01.851918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584e4a5-38e8-4da0-9df8-ec94968a0e38 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:01.852374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584e4a5-38e8-4da0-9df8-ec94968a0e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:01.878785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceccfd1-3414-46d7-82b7-88478f1ccc2a admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:01.886523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2584e4a5-38e8-4da0-9df8-ec94968a0e38 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:01.889055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2584e4a5-38e8-4da0-9df8-ec94968a0e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:01.982717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 830/1668] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:01.984216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd27c-0e3e-4457-b350-4ebac9ad8512 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:01.984578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd27c-0e3e-4457-b350-4ebac9ad8512 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:01.984928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbd27c-0e3e-4457-b350-4ebac9ad8512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:02.044848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dba1ce-daaf-445d-b04b-c1b37a2146e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:02.046256 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba1ce-daaf-445d-b04b-c1b37a2146e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:02.046684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba1ce-daaf-445d-b04b-c1b37a2146e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:02.047334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dba1ce-daaf-445d-b04b-c1b37a2146e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:02.048128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dba1ce-daaf-445d-b04b-c1b37a2146e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:02.049144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-bbdbd27c-0e3e-4457-b350-4ebac9ad8512 None None] MFA Rules not processed for user `49c56e649fb14a3caf3f2257f6023de1`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:02.050666 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-bbdbd27c-0e3e-4457-b350-4ebac9ad8512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:02.052345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dba1ce-daaf-445d-b04b-c1b37a2146e0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:02.070485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 839/1669] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:02.076713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dba1ce-daaf-445d-b04b-c1b37a2146e0 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:02.079003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c7dba1ce-daaf-445d-b04b-c1b37a2146e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:02.226375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 831/1670] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:02.227269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbd27c-0e3e-4457-b350-4ebac9ad8512 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:02.249471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dba1ce-daaf-445d-b04b-c1b37a2146e0 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:02.255219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbd27c-0e3e-4457-b350-4ebac9ad8512 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:02.267055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030274-f5f8-4121-939d-dc8f5d631f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:02.268155 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030274-f5f8-4121-939d-dc8f5d631f33 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:02.268492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968a68a-de79-41a9-aed6-fe4bc7e9735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:02.269112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030274-f5f8-4121-939d-dc8f5d631f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:02.269226 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968a68a-de79-41a9-aed6-fe4bc7e9735b admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:02.269551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968a68a-de79-41a9-aed6-fe4bc7e9735b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:02.269835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968a68a-de79-41a9-aed6-fe4bc7e9735b admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:02.270621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968a68a-de79-41a9-aed6-fe4bc7e9735b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:02.271346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030274-f5f8-4121-939d-dc8f5d631f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:02.272346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968a68a-de79-41a9-aed6-fe4bc7e9735b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:02.292703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 832/1671] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:02.295294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578ba42-8b95-4bd0-abd3-8552ee394a7d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:02.295607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578ba42-8b95-4bd0-abd3-8552ee394a7d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:02.295891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578ba42-8b95-4bd0-abd3-8552ee394a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:02.297952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030274-f5f8-4121-939d-dc8f5d631f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:02.300848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030274-f5f8-4121-939d-dc8f5d631f33 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:02.330751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 840/1672] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:02.331427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030274-f5f8-4121-939d-dc8f5d631f33 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:02.340971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-a578ba42-8b95-4bd0-abd3-8552ee394a7d None None] MFA Rules not processed for user `49c56e649fb14a3caf3f2257f6023de1`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:02.342196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a578ba42-8b95-4bd0-abd3-8552ee394a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:02.352233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030274-f5f8-4121-939d-dc8f5d631f33 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:02.363373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 833/1673] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:02.370786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542276a-9b80-45b0-ba85-c8ae280c1bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:02.371795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542276a-9b80-45b0-ba85-c8ae280c1bee admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:02.372779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542276a-9b80-45b0-ba85-c8ae280c1bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:02.373119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542276a-9b80-45b0-ba85-c8ae280c1bee admin admin] PATH_INFO: `/v3/projects/a5e0a480e4424647be1f005b2321442a/users/b172775738b54b8faeb158fe8dd0c476/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:02.377681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578ba42-8b95-4bd0-abd3-8552ee394a7d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:02.379316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a578ba42-8b95-4bd0-abd3-8552ee394a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:02.419442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542276a-9b80-45b0-ba85-c8ae280c1bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e0a480e4424647be1f005b2321442a, user_id=b172775738b54b8faeb158fe8dd0c476, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:02.423864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542276a-9b80-45b0-ba85-c8ae280c1bee admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:02.455681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 841/1674] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:02 2022] PUT /identity/v3/projects/a5e0a480e4424647be1f005b2321442a/users/b172775738b54b8faeb158fe8dd0c476/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:02.474854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade007d-bdd8-4014-8a14-5b003ff35ba0 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:02.474854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade007d-bdd8-4014-8a14-5b003ff35ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:02.475096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade007d-bdd8-4014-8a14-5b003ff35ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:02.495365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:02.514813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:02.551914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-5ade007d-bdd8-4014-8a14-5b003ff35ba0 None None] MFA Rules not processed for user `b172775738b54b8faeb158fe8dd0c476`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:02.555740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5ade007d-bdd8-4014-8a14-5b003ff35ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:02.584592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578ba42-8b95-4bd0-abd3-8552ee394a7d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:02.716499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307171ab-ea3d-428b-a7c5-d80470b9e795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:02.717316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307171ab-ea3d-428b-a7c5-d80470b9e795 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:02.717509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307171ab-ea3d-428b-a7c5-d80470b9e795 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:02.717792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307171ab-ea3d-428b-a7c5-d80470b9e795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:02.772830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 842/1675] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:02.776866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade007d-bdd8-4014-8a14-5b003ff35ba0 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:02.778581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5ade007d-bdd8-4014-8a14-5b003ff35ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:02.785499 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307171ab-ea3d-428b-a7c5-d80470b9e795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:02.787110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307171ab-ea3d-428b-a7c5-d80470b9e795 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:02.798697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 834/1676] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:02.999823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade007d-bdd8-4014-8a14-5b003ff35ba0 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:03.011721 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e2e7c-509f-4cd9-a507-af7e922952cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:03.013294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2e7c-509f-4cd9-a507-af7e922952cd service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:03.014195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2e7c-509f-4cd9-a507-af7e922952cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:03.014569 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2e7c-509f-4cd9-a507-af7e922952cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:03.030765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e2e7c-509f-4cd9-a507-af7e922952cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:03.032478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e2e7c-509f-4cd9-a507-af7e922952cd service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:03.055017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 843/1677] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:04.143798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81c2cf-5ecc-4670-8ce4-828d1b557b6a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:04.144390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81c2cf-5ecc-4670-8ce4-828d1b557b6a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:04.144390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81c2cf-5ecc-4670-8ce4-828d1b557b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:04.188782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0a81c2cf-5ecc-4670-8ce4-828d1b557b6a None None] MFA Rules not processed for user `e53d89b5cb02499f845d3364c6c54c38`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:04.190623 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0a81c2cf-5ecc-4670-8ce4-828d1b557b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:04.312826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 835/1678] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:04.317561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e2e7c-509f-4cd9-a507-af7e922952cd service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:04.487078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e2e7c-509f-4cd9-a507-af7e922952cd service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:04.499393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5685ae7-cdb0-43f6-ba49-1bb27f08e069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:04.500911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5685ae7-cdb0-43f6-ba49-1bb27f08e069 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:04.501224 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5685ae7-cdb0-43f6-ba49-1bb27f08e069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:04.501502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5685ae7-cdb0-43f6-ba49-1bb27f08e069 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:04.502215 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5685ae7-cdb0-43f6-ba49-1bb27f08e069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:04.506016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5685ae7-cdb0-43f6-ba49-1bb27f08e069 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:04.563644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 844/1679] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:04 2022] POST /identity/v3/projects => generated 405 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:04.568229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81c2cf-5ecc-4670-8ce4-828d1b557b6a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:04.588488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81c2cf-5ecc-4670-8ce4-828d1b557b6a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:04.601700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:04.675619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cca4ad-2473-443d-b284-f764592f3a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:04.676344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cca4ad-2473-443d-b284-f764592f3a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:04.676630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cca4ad-2473-443d-b284-f764592f3a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:04.676906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cca4ad-2473-443d-b284-f764592f3a0a admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:04.678218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cca4ad-2473-443d-b284-f764592f3a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:04.680331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cca4ad-2473-443d-b284-f764592f3a0a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:04.712013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 836/1680] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:04 2022] POST /identity/v3/users => generated 309 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:04.717225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5685ae7-cdb0-43f6-ba49-1bb27f08e069 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:04.731535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5685ae7-cdb0-43f6-ba49-1bb27f08e069 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:04.738877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec743355-238b-40f5-a037-e97ae93b4313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:04.739885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743355-238b-40f5-a037-e97ae93b4313 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:04.740760 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743355-238b-40f5-a037-e97ae93b4313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:04.741293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec743355-238b-40f5-a037-e97ae93b4313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:04.742190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec743355-238b-40f5-a037-e97ae93b4313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:04.744731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec743355-238b-40f5-a037-e97ae93b4313 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:04.763011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 845/1681] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:04.766939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cca4ad-2473-443d-b284-f764592f3a0a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:04.781956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cca4ad-2473-443d-b284-f764592f3a0a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:04.787389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d754234-3b8e-41f5-9d4a-4c2e99885684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:04.791160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d754234-3b8e-41f5-9d4a-4c2e99885684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:04.791665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d754234-3b8e-41f5-9d4a-4c2e99885684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:04.792119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d754234-3b8e-41f5-9d4a-4c2e99885684 admin admin] PATH_INFO: `/v3/projects/e048fdfb5149481285edcb1c5b4dd525/users/3ed163a9ea364228abec4cffd83079b4/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:04.812638 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d754234-3b8e-41f5-9d4a-4c2e99885684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e048fdfb5149481285edcb1c5b4dd525, user_id=3ed163a9ea364228abec4cffd83079b4, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:04.815996 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d754234-3b8e-41f5-9d4a-4c2e99885684 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:04.836945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 837/1682] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:04 2022] PUT /identity/v3/projects/e048fdfb5149481285edcb1c5b4dd525/users/3ed163a9ea364228abec4cffd83079b4/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:04.842709 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec743355-238b-40f5-a037-e97ae93b4313 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:04.860691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec743355-238b-40f5-a037-e97ae93b4313 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:04.876738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:04.951793 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4ce76-ae61-44d1-97b0-fd15b2f7c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:04.952900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ce76-ae61-44d1-97b0-fd15b2f7c9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:04.953285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ce76-ae61-44d1-97b0-fd15b2f7c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:04.953828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ce76-ae61-44d1-97b0-fd15b2f7c9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:04.954667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4ce76-ae61-44d1-97b0-fd15b2f7c9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:04.956955 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4ce76-ae61-44d1-97b0-fd15b2f7c9c5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:04.970597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 846/1683] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:04.974892 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d754234-3b8e-41f5-9d4a-4c2e99885684 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:04.990589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d754234-3b8e-41f5-9d4a-4c2e99885684 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:04.996771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1faadb5-4808-40f9-b7c2-42535c183b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:04.999191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1faadb5-4808-40f9-b7c2-42535c183b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:04.999611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1faadb5-4808-40f9-b7c2-42535c183b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:05.000267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1faadb5-4808-40f9-b7c2-42535c183b18 admin admin] PATH_INFO: `/v3/projects/e048fdfb5149481285edcb1c5b4dd525/users/3ed163a9ea364228abec4cffd83079b4/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:05.003225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1faadb5-4808-40f9-b7c2-42535c183b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e048fdfb5149481285edcb1c5b4dd525, user_id=3ed163a9ea364228abec4cffd83079b4, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:05.008997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d87e5-84f3-464e-9005-6dbb699e4f1e None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:05.009594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d87e5-84f3-464e-9005-6dbb699e4f1e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:05.010029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d87e5-84f3-464e-9005-6dbb699e4f1e None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:05.013133 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 847/1684] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jun 16 00:25:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:05.031234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eeb13-917d-458c-8705-4273374a7d13 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:05.031579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eeb13-917d-458c-8705-4273374a7d13 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:05.031867 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eeb13-917d-458c-8705-4273374a7d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:05.039626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1faadb5-4808-40f9-b7c2-42535c183b18 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:05.079738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 838/1685] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:04 2022] PUT /identity/v3/projects/e048fdfb5149481285edcb1c5b4dd525/users/3ed163a9ea364228abec4cffd83079b4/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:05.108900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4f5eeb13-917d-458c-8705-4273374a7d13 None None] MFA Rules not processed for user `9c142f4d77b54982abcd4b76edbcb4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:05.110458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4f5eeb13-917d-458c-8705-4273374a7d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:05.197570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 848/1686] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:25:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:05.222378 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1faadb5-4808-40f9-b7c2-42535c183b18 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:05.225561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d1faadb5-4808-40f9-b7c2-42535c183b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:05.259042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1faadb5-4808-40f9-b7c2-42535c183b18 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:05.271694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a47f70-df5c-4c4d-8f46-abbdf7828c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:05.274105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a47f70-df5c-4c4d-8f46-abbdf7828c39 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:05.275442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a47f70-df5c-4c4d-8f46-abbdf7828c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:05.276642 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a47f70-df5c-4c4d-8f46-abbdf7828c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:05.312344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a47f70-df5c-4c4d-8f46-abbdf7828c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:05.319030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a47f70-df5c-4c4d-8f46-abbdf7828c39 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:05.342149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 839/1687] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:08.225213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f587-e9a3-44ea-b142-028b81121282 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:08.225783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f587-e9a3-44ea-b142-028b81121282 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:08.225783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f587-e9a3-44ea-b142-028b81121282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:08.293029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a316f587-e9a3-44ea-b142-028b81121282 None None] MFA Rules not processed for user `8628dfd28dd641f88a53e9ff0da20d90`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:08.294284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a316f587-e9a3-44ea-b142-028b81121282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:08.411905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 849/1688] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:08.425893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6347a15-6244-4067-829f-402895166e67 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:08.426433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6347a15-6244-4067-829f-402895166e67 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:08.426918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6347a15-6244-4067-829f-402895166e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:08.494906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e6347a15-6244-4067-829f-402895166e67 None None] MFA Rules not processed for user `8628dfd28dd641f88a53e9ff0da20d90`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:08.496336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e6347a15-6244-4067-829f-402895166e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:08.516398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 840/1689] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:08.518301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7ea6-5cd8-4f67-a8ad-21c44c1f031b None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:08.518709 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7ea6-5cd8-4f67-a8ad-21c44c1f031b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:08.518875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7ea6-5cd8-4f67-a8ad-21c44c1f031b None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:08.520536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 850/1690] 10.222.0.16 () {54 vars in 960 bytes} [Thu Jun 16 00:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:08.527636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b7ea6-5cd8-4f67-a8ad-21c44c1f031b None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:08.528009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8474550-6bbc-445b-a523-b7eba616028f None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:08.537274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8474550-6bbc-445b-a523-b7eba616028f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:08.537914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8474550-6bbc-445b-a523-b7eba616028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:08.577543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e8474550-6bbc-445b-a523-b7eba616028f None None] MFA Rules not processed for user `7dde39c6d85446a681dea24573f0d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:08.582726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e8474550-6bbc-445b-a523-b7eba616028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:08.587874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:08.650052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b7ea6-5cd8-4f67-a8ad-21c44c1f031b None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:08.662015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4f969-201a-43b5-acd9-d9a17d48b062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:08.663014 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4f969-201a-43b5-acd9-d9a17d48b062 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:08.663519 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4f969-201a-43b5-acd9-d9a17d48b062 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:08.663944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4f969-201a-43b5-acd9-d9a17d48b062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:08.678772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4f969-201a-43b5-acd9-d9a17d48b062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:08.680847 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4f969-201a-43b5-acd9-d9a17d48b062 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:08.699115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 851/1691] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:25:08.790089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 841/1692] 10.222.0.16 () {58 vars in 1057 bytes} [Thu Jun 16 00:25:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:08.821680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4f969-201a-43b5-acd9-d9a17d48b062 service nova] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:08.848108 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4f969-201a-43b5-acd9-d9a17d48b062 service nova] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:08.854403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7051e-b5b1-433e-8800-8c9c13150833 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dde39c6d85446a681dea24573f0d6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:08.855341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7051e-b5b1-433e-8800-8c9c13150833 service placement] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:08.855823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7051e-b5b1-433e-8800-8c9c13150833 service placement] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:08.856365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7051e-b5b1-433e-8800-8c9c13150833 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:08.858384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f0f7051e-b5b1-433e-8800-8c9c13150833 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:08.881914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7051e-b5b1-433e-8800-8c9c13150833 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:08.884612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7051e-b5b1-433e-8800-8c9c13150833 service placement] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:08.918183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 852/1693] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:09.180843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffde65-bf67-4e7a-bae0-098f69bd6366 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:09.181368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffde65-bf67-4e7a-bae0-098f69bd6366 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:09.181838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffde65-bf67-4e7a-bae0-098f69bd6366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:09.239733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-34ffde65-bf67-4e7a-bae0-098f69bd6366 None None] MFA Rules not processed for user `3ed163a9ea364228abec4cffd83079b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:09.241367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-34ffde65-bf67-4e7a-bae0-098f69bd6366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:09.284191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:09.368212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 842/1694] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:10.606669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb2c2d-7285-468d-a3af-c58e35e962f5 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:10.607027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb2c2d-7285-468d-a3af-c58e35e962f5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:10.607200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb2c2d-7285-468d-a3af-c58e35e962f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:10.701085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b9eb2c2d-7285-468d-a3af-c58e35e962f5 None None] MFA Rules not processed for user `f8dd78b473fc4b2bbe3d85471419f594`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:10.703124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b9eb2c2d-7285-468d-a3af-c58e35e962f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:11.005275 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c488eb-2d06-4b4c-a7cf-2d4d00e4e452 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:11.005760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c488eb-2d06-4b4c-a7cf-2d4d00e4e452 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:11.005861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c488eb-2d06-4b4c-a7cf-2d4d00e4e452 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:11.007802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 843/1695] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:25:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:11.013242 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e984-4756-4cb8-9b36-7fa03451dc8c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:11.013444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e984-4756-4cb8-9b36-7fa03451dc8c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:11.013728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e984-4756-4cb8-9b36-7fa03451dc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:11.056667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 853/1696] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:11.064487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb2c2d-7285-468d-a3af-c58e35e962f5 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:11.066246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b9eb2c2d-7285-468d-a3af-c58e35e962f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:11.068580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4df1e984-4756-4cb8-9b36-7fa03451dc8c None None] MFA Rules not processed for user `7dde39c6d85446a681dea24573f0d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:11.076361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4df1e984-4756-4cb8-9b36-7fa03451dc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:11.138592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 844/1697] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:25:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:11.166651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1e984-4756-4cb8-9b36-7fa03451dc8c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:11.174059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb2c2d-7285-468d-a3af-c58e35e962f5 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:11.192333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1e984-4756-4cb8-9b36-7fa03451dc8c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:11.200610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93051b4a-9626-4085-9142-4fdc73911741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:11.207470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051b4a-9626-4085-9142-4fdc73911741 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:11.207729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051b4a-9626-4085-9142-4fdc73911741 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:11.208036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051b4a-9626-4085-9142-4fdc73911741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:11.213179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4460e-ff7c-47a2-ab7c-23845235bd74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dde39c6d85446a681dea24573f0d6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:11.214360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4460e-ff7c-47a2-ab7c-23845235bd74 service placement] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:11.214834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4460e-ff7c-47a2-ab7c-23845235bd74 service placement] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:11.217375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4460e-ff7c-47a2-ab7c-23845235bd74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:11.229437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4460e-ff7c-47a2-ab7c-23845235bd74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:11.232904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4460e-ff7c-47a2-ab7c-23845235bd74 service placement] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:11.253360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93051b4a-9626-4085-9142-4fdc73911741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:11.265180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93051b4a-9626-4085-9142-4fdc73911741 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:11.273477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 845/1698] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:25:11.311316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 854/1699] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:12.521040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64212-4e5f-4f8c-ab5c-dca906732b80 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:12.521991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64212-4e5f-4f8c-ab5c-dca906732b80 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:12.522414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64212-4e5f-4f8c-ab5c-dca906732b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:12.562400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-90a64212-4e5f-4f8c-ab5c-dca906732b80 None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:12.567502 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-90a64212-4e5f-4f8c-ab5c-dca906732b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:12.781214 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 846/1700] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:25:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:13.095263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93051b4a-9626-4085-9142-4fdc73911741 service nova] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:13.097401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-93051b4a-9626-4085-9142-4fdc73911741 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:13.367449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93051b4a-9626-4085-9142-4fdc73911741 service nova] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:13.382470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4c5dd-6fe5-4517-b89e-74f944b09316 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:13.383161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4c5dd-6fe5-4517-b89e-74f944b09316 service swift] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:13.383455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4c5dd-6fe5-4517-b89e-74f944b09316 service swift] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:13.383742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4c5dd-6fe5-4517-b89e-74f944b09316 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:13.406439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4c5dd-6fe5-4517-b89e-74f944b09316 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:13.411071 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4c5dd-6fe5-4517-b89e-74f944b09316 service swift] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:13.446671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 855/1701] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:25:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:25:13.454543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94450c-3634-45a3-929f-f7e76f4f6909 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:13.454786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94450c-3634-45a3-929f-f7e76f4f6909 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:13.455068 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94450c-3634-45a3-929f-f7e76f4f6909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:13.516000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-fb94450c-3634-45a3-929f-f7e76f4f6909 None None] MFA Rules not processed for user `8628dfd28dd641f88a53e9ff0da20d90`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:13.517459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-fb94450c-3634-45a3-929f-f7e76f4f6909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:13.569761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 847/1702] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:14.836986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4c5dd-6fe5-4517-b89e-74f944b09316 service swift] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:14.877126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:15.057235 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4c5dd-6fe5-4517-b89e-74f944b09316 service swift] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:15.084877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:15.085861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:15.086147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:15.086427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] PATH_INFO: `/v3/users/e53d89b5cb02499f845d3364c6c54c38` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:15.087752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94450c-3634-45a3-929f-f7e76f4f6909 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:15.104854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53d89b5cb02499f845d3364c6c54c38)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:15.106872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:15.110513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94450c-3634-45a3-929f-f7e76f4f6909 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:15.135891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808400d-bd8c-42bc-b637-6a426f031d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:15.139617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808400d-bd8c-42bc-b637-6a426f031d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:15.139905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808400d-bd8c-42bc-b637-6a426f031d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:15.147462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808400d-bd8c-42bc-b637-6a426f031d35 admin admin] PATH_INFO: `/v3/users/b172775738b54b8faeb158fe8dd0c476` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:15.160915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808400d-bd8c-42bc-b637-6a426f031d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b172775738b54b8faeb158fe8dd0c476)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:15.163173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808400d-bd8c-42bc-b637-6a426f031d35 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:15.348938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53d89b5cb02499f845d3364c6c54c38'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:15.352028 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53d89b5cb02499f845d3364c6c54c38'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:15.384173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b808400d-bd8c-42bc-b637-6a426f031d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b172775738b54b8faeb158fe8dd0c476'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:15.401174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b808400d-bd8c-42bc-b637-6a426f031d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b172775738b54b8faeb158fe8dd0c476'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:15.402390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b808400d-bd8c-42bc-b637-6a426f031d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b172775738b54b8faeb158fe8dd0c476'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:15.415212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b808400d-bd8c-42bc-b637-6a426f031d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b172775738b54b8faeb158fe8dd0c476'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:15.425859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53d89b5cb02499f845d3364c6c54c38'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:15.429558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53d89b5cb02499f845d3364c6c54c38'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:15.450903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b808400d-bd8c-42bc-b637-6a426f031d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b172775738b54b8faeb158fe8dd0c476'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:15.464131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53d89b5cb02499f845d3364c6c54c38'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:15.479263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 848/1703] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:15 2022] DELETE /identity/v3/users/b172775738b54b8faeb158fe8dd0c476 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:15.484822 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44a58-31d3-4f0e-a98d-be6b03fa203c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:15.485373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44a58-31d3-4f0e-a98d-be6b03fa203c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:15.485848 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db44a58-31d3-4f0e-a98d-be6b03fa203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:15.510987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-8db44a58-31d3-4f0e-a98d-be6b03fa203c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:15.513451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8db44a58-31d3-4f0e-a98d-be6b03fa203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:15.529078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:15.563311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 856/1704] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:14 2022] DELETE /identity/v3/users/e53d89b5cb02499f845d3364c6c54c38 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:15.724502 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 849/1705] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:15.819080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:15.821550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:15.974356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db44a58-31d3-4f0e-a98d-be6b03fa203c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:15.976267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8db44a58-31d3-4f0e-a98d-be6b03fa203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:15.979343 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19877d6-5646-4131-bb42-261be5e66e78 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:15.988548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437075a-9caf-413b-bf3b-0aa9c8fc8cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:15.989666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437075a-9caf-413b-bf3b-0aa9c8fc8cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:15.990331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437075a-9caf-413b-bf3b-0aa9c8fc8cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:15.990766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437075a-9caf-413b-bf3b-0aa9c8fc8cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:16.016938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db44a58-31d3-4f0e-a98d-be6b03fa203c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:16.051569 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:16.120015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437075a-9caf-413b-bf3b-0aa9c8fc8cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:16.122589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:16.124463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437075a-9caf-413b-bf3b-0aa9c8fc8cf1 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:16.125136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:16.125600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:16.126677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] PATH_INFO: `/v3/users/7f87788cc90e46e5a677376c61a4447b` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:16.129302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f87788cc90e46e5a677376c61a4447b)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:16.131589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:16.151610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 857/1706] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:16.223983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f87788cc90e46e5a677376c61a4447b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:16.246543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f87788cc90e46e5a677376c61a4447b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:16.247730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f87788cc90e46e5a677376c61a4447b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:16.261743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f87788cc90e46e5a677376c61a4447b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:16.281476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f87788cc90e46e5a677376c61a4447b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:16.293885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 850/1707] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:15 2022] DELETE /identity/v3/users/7f87788cc90e46e5a677376c61a4447b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:16.299052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c10cb-17b6-46f0-bafc-817f5089fdd5 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:16.299403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c10cb-17b6-46f0-bafc-817f5089fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:16.299762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c10cb-17b6-46f0-bafc-817f5089fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:16.337521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-945c10cb-17b6-46f0-bafc-817f5089fdd5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:16.341199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-945c10cb-17b6-46f0-bafc-817f5089fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:16.429742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 858/1708] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:16.505462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:16.507122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:16.600957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:16.644244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2efb79-922d-4452-8383-ff05e81dcff4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:16.649929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc8578-c09a-4f6e-af9c-3575ce1ff149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:16.650899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc8578-c09a-4f6e-af9c-3575ce1ff149 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:16.651479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc8578-c09a-4f6e-af9c-3575ce1ff149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:16.652034 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc8578-c09a-4f6e-af9c-3575ce1ff149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:16.669022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc8578-c09a-4f6e-af9c-3575ce1ff149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:16.670782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc8578-c09a-4f6e-af9c-3575ce1ff149 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:16.672208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a9e53-202a-4125-b1b6-7d2f04def5f2 None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:16.672504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a9e53-202a-4125-b1b6-7d2f04def5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:16.672965 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a9e53-202a-4125-b1b6-7d2f04def5f2 None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:16.675154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 859/1709] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jun 16 00:25:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:16.681433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf62f-5ebd-4dca-823f-ab8fca980ed6 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:16.681831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf62f-5ebd-4dca-823f-ab8fca980ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:16.682278 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf62f-5ebd-4dca-823f-ab8fca980ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:16.698719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 851/1710] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:16.703914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-3b4bf62f-5ebd-4dca-823f-ab8fca980ed6 None None] MFA Rules not processed for user `9c142f4d77b54982abcd4b76edbcb4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:16.710013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3b4bf62f-5ebd-4dca-823f-ab8fca980ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:16.738392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 860/1711] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:25:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:16.763237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc8578-c09a-4f6e-af9c-3575ce1ff149 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:16.765100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ccdc8578-c09a-4f6e-af9c-3575ce1ff149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:16.790370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc8578-c09a-4f6e-af9c-3575ce1ff149 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:16.804544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91dac2-bc64-4778-8330-c4ad21ea15cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:16.805743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91dac2-bc64-4778-8330-c4ad21ea15cf service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:16.806323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91dac2-bc64-4778-8330-c4ad21ea15cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:16.806911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91dac2-bc64-4778-8330-c4ad21ea15cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:16.827562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91dac2-bc64-4778-8330-c4ad21ea15cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:16.838423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91dac2-bc64-4778-8330-c4ad21ea15cf service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:16.860701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 852/1712] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:17.550151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bf62f-5ebd-4dca-823f-ab8fca980ed6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:17.551745 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3b4bf62f-5ebd-4dca-823f-ab8fca980ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:17.599250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bf62f-5ebd-4dca-823f-ab8fca980ed6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:17.605784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:17.606925 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:17.607219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:17.607497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] PATH_INFO: `/v3/projects/a5e0a480e4424647be1f005b2321442a` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:17.609083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e0a480e4424647be1f005b2321442a)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:17.611739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:17.727281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e0a480e4424647be1f005b2321442a', 'request_id': 'req-880d6971-fc84-4eab-ad0c-c2e72791af24'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:17.744987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e0a480e4424647be1f005b2321442a', 'request_id': 'req-880d6971-fc84-4eab-ad0c-c2e72791af24'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:17.755244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e0a480e4424647be1f005b2321442a', 'request_id': 'req-880d6971-fc84-4eab-ad0c-c2e72791af24'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:17.781721 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] The token cache is being invalidate because project a5e0a480e4424647be1f005b2321442a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:17.782058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:17.784831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-880d6971-fc84-4eab-ad0c-c2e72791af24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:17.792150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 861/1713] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:17 2022] DELETE /identity/v3/projects/a5e0a480e4424647be1f005b2321442a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:17.795281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ca515-c876-4b16-87f7-eeabb160c8c7 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:17.795794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ca515-c876-4b16-87f7-eeabb160c8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:17.795874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ca515-c876-4b16-87f7-eeabb160c8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:17.852310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ab9ca515-c876-4b16-87f7-eeabb160c8c7 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:17.865589 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ab9ca515-c876-4b16-87f7-eeabb160c8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:17.989129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 853/1714] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:17.998043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9090a-3d21-4261-a253-bb90d8b3a445 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:17.998348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9090a-3d21-4261-a253-bb90d8b3a445 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:17.998604 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9090a-3d21-4261-a253-bb90d8b3a445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:18.050023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-0cb9090a-3d21-4261-a253-bb90d8b3a445 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:18.060345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-0cb9090a-3d21-4261-a253-bb90d8b3a445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:18.095499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 862/1715] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:18.096383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ca515-c876-4b16-87f7-eeabb160c8c7 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:18.112942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ca515-c876-4b16-87f7-eeabb160c8c7 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:18.120880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9090a-3d21-4261-a253-bb90d8b3a445 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:18.122922 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-0cb9090a-3d21-4261-a253-bb90d8b3a445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:18.126812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffef01-d2d4-4df6-a821-bb7f942470cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:18.127595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffef01-d2d4-4df6-a821-bb7f942470cc admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:18.127888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffef01-d2d4-4df6-a821-bb7f942470cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:18.128195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffef01-d2d4-4df6-a821-bb7f942470cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:18.128950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffef01-d2d4-4df6-a821-bb7f942470cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:18.129263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffef01-d2d4-4df6-a821-bb7f942470cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:18.137204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffef01-d2d4-4df6-a821-bb7f942470cc admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:18.141427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9090a-3d21-4261-a253-bb90d8b3a445 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:18.163337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:18.164660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:18.164966 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:18.165250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] PATH_INFO: `/v3/projects/9608be21abd04ddebd1abec8f50d2a09` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:18.172256 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9608be21abd04ddebd1abec8f50d2a09)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:18.180427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:18.208229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 854/1716] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:18.213093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffef01-d2d4-4df6-a821-bb7f942470cc admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:18.241512 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffef01-d2d4-4df6-a821-bb7f942470cc admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:18.272391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf50d9-ac2f-4496-abdd-3d54976dc925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:18.273300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf50d9-ac2f-4496-abdd-3d54976dc925 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:18.280259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf50d9-ac2f-4496-abdd-3d54976dc925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:18.280735 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf50d9-ac2f-4496-abdd-3d54976dc925 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:18.281843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf50d9-ac2f-4496-abdd-3d54976dc925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:18.284190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf50d9-ac2f-4496-abdd-3d54976dc925 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:18.347362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:18.349866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9608be21abd04ddebd1abec8f50d2a09', 'request_id': 'req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:18.374187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 855/1717] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:18 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:18.384495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf50d9-ac2f-4496-abdd-3d54976dc925 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:18.385102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9608be21abd04ddebd1abec8f50d2a09', 'request_id': 'req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:18.397171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9608be21abd04ddebd1abec8f50d2a09', 'request_id': 'req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:18.444207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] The token cache is being invalidate because project 9608be21abd04ddebd1abec8f50d2a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:18.444531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:18.447195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:18.456480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 863/1718] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:18 2022] DELETE /identity/v3/projects/9608be21abd04ddebd1abec8f50d2a09 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:18.460272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:18.465131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:18.609660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf50d9-ac2f-4496-abdd-3d54976dc925 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:18.622113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf5022-d98b-4074-856f-2bf03bf2e688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:18.622951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf5022-d98b-4074-856f-2bf03bf2e688 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:18.623282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf5022-d98b-4074-856f-2bf03bf2e688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:18.623662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf5022-d98b-4074-856f-2bf03bf2e688 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:18.624836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf5022-d98b-4074-856f-2bf03bf2e688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:18.631413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf5022-d98b-4074-856f-2bf03bf2e688 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:18.638940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8f51-8178-4fc6-a8e7-348d3e4bf85e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:18.653989 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:18.655059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:18.655408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:18.655799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] PATH_INFO: `/v3/users/3ed163a9ea364228abec4cffd83079b4` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:18.659191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed163a9ea364228abec4cffd83079b4)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:18.665025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:18.677342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 856/1719] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:18 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:18.681846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf5022-d98b-4074-856f-2bf03bf2e688 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:18.685513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-1faf5022-d98b-4074-856f-2bf03bf2e688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:18.712662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf5022-d98b-4074-856f-2bf03bf2e688 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:18.718354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8edb0f-9b7a-4e10-853c-a578052b18c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:18.719367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8edb0f-9b7a-4e10-853c-a578052b18c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:18.720004 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8edb0f-9b7a-4e10-853c-a578052b18c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:18.720539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8edb0f-9b7a-4e10-853c-a578052b18c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:18.721399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8edb0f-9b7a-4e10-853c-a578052b18c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:18.723149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8edb0f-9b7a-4e10-853c-a578052b18c4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:18.745641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 857/1720] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:18.750349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8edb0f-9b7a-4e10-853c-a578052b18c4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:18.781668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8edb0f-9b7a-4e10-853c-a578052b18c4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:18.797681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389665a-2bc3-4e64-a2ad-5c307377b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:18.800069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389665a-2bc3-4e64-a2ad-5c307377b1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:18.801160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389665a-2bc3-4e64-a2ad-5c307377b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:18.805159 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389665a-2bc3-4e64-a2ad-5c307377b1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:18.806007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389665a-2bc3-4e64-a2ad-5c307377b1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:18.807767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389665a-2bc3-4e64-a2ad-5c307377b1b7 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:18.823009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:18.861786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed163a9ea364228abec4cffd83079b4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:18.863547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed163a9ea364228abec4cffd83079b4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:18.870366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 858/1721] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:18.870366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d9839-d0f1-4f36-9d00-b2be7241c226 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:18.870366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d9839-d0f1-4f36-9d00-b2be7241c226 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:18.870366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d9839-d0f1-4f36-9d00-b2be7241c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:18.903296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed163a9ea364228abec4cffd83079b4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:18.904965 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed163a9ea364228abec4cffd83079b4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:18.923183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed163a9ea364228abec4cffd83079b4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:18.955899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 864/1722] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:18 2022] DELETE /identity/v3/users/3ed163a9ea364228abec4cffd83079b4 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:18.957138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:18.960701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:18.978252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-841d9839-d0f1-4f36-9d00-b2be7241c226 None None] MFA Rules not processed for user `fbc6b66ed796481abf4fdea66692f4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:18.980037 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-841d9839-d0f1-4f36-9d00-b2be7241c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:19.160109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:19.175003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125d17-fbfe-4b58-ae04-437e46d0addc admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:19.223632 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857da3-dbf4-4cb6-97d7-6f5c5f845bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:19.228228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857da3-dbf4-4cb6-97d7-6f5c5f845bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:19.228706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857da3-dbf4-4cb6-97d7-6f5c5f845bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:19.229148 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857da3-dbf4-4cb6-97d7-6f5c5f845bf2 admin admin] PATH_INFO: `/v3/projects/d2d825ef4c8c48d9ac7c103c63c6265f/users/dfd33d950ddb41fbab56b161fe3369a0/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:19.281944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67857da3-dbf4-4cb6-97d7-6f5c5f845bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d825ef4c8c48d9ac7c103c63c6265f, user_id=dfd33d950ddb41fbab56b161fe3369a0, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:19.284764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67857da3-dbf4-4cb6-97d7-6f5c5f845bf2 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:19.356116 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 865/1723] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:18 2022] PUT /identity/v3/projects/d2d825ef4c8c48d9ac7c103c63c6265f/users/dfd33d950ddb41fbab56b161fe3369a0/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:19.367197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f3b65-9640-47c2-ac97-8649eaae94d1 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:19.368863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 859/1724] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:19.372771 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f3b65-9640-47c2-ac97-8649eaae94d1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:19.373318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f3b65-9640-47c2-ac97-8649eaae94d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:19.538059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b03f3b65-9640-47c2-ac97-8649eaae94d1 None None] MFA Rules not processed for user `dfd33d950ddb41fbab56b161fe3369a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:19.547749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b03f3b65-9640-47c2-ac97-8649eaae94d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:19.894483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 866/1725] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:19.899040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d9839-d0f1-4f36-9d00-b2be7241c226 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:19.925432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d9839-d0f1-4f36-9d00-b2be7241c226 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:20.093063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f3b65-9640-47c2-ac97-8649eaae94d1 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:20.094542 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b03f3b65-9640-47c2-ac97-8649eaae94d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:20.156846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a39b53-f57c-4223-a312-d8c21c7458a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:20.157973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a39b53-f57c-4223-a312-d8c21c7458a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:20.159954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a39b53-f57c-4223-a312-d8c21c7458a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:20.160260 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a39b53-f57c-4223-a312-d8c21c7458a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:20.160978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a39b53-f57c-4223-a312-d8c21c7458a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:20.175014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a39b53-f57c-4223-a312-d8c21c7458a8 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:20.278496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 860/1726] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:19 2022] POST /identity/v3/projects => generated 365 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:20.281195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a39b53-f57c-4223-a312-d8c21c7458a8 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:20.387004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f3b65-9640-47c2-ac97-8649eaae94d1 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:20.561739 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a39b53-f57c-4223-a312-d8c21c7458a8 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:20.577791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fea1c-4cf5-416e-b1f6-f86600014e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:20.578498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fea1c-4cf5-416e-b1f6-f86600014e12 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:20.578788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fea1c-4cf5-416e-b1f6-f86600014e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:20.579068 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fea1c-4cf5-416e-b1f6-f86600014e12 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:20.579771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fea1c-4cf5-416e-b1f6-f86600014e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:20.593916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376fea1c-4cf5-416e-b1f6-f86600014e12 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:20.632428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:20.674260 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 861/1727] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:20 2022] POST /identity/v3/users => generated 289 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:25:20.676004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8a3c0-07b5-4cd0-b0c4-bd940a65ba72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:20.678224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fea1c-4cf5-416e-b1f6-f86600014e12 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:20.679873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8a3c0-07b5-4cd0-b0c4-bd940a65ba72 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:20.685360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:20.685846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8a3c0-07b5-4cd0-b0c4-bd940a65ba72 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:20.687916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8a3c0-07b5-4cd0-b0c4-bd940a65ba72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:20.710784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fea1c-4cf5-416e-b1f6-f86600014e12 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:20.728753 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb9755-ad6f-4915-b960-6e2099143283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:20.729632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9755-ad6f-4915-b960-6e2099143283 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:20.732346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9755-ad6f-4915-b960-6e2099143283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:20.733715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9755-ad6f-4915-b960-6e2099143283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:20.735743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb9755-ad6f-4915-b960-6e2099143283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:20.738116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb9755-ad6f-4915-b960-6e2099143283 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:20.770162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 862/1728] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:20.772964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb9755-ad6f-4915-b960-6e2099143283 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:20.803110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb9755-ad6f-4915-b960-6e2099143283 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:20.818473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f4bb3-8e9e-4608-8bd9-7329cfdfd1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:20.821095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f4bb3-8e9e-4608-8bd9-7329cfdfd1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:20.822185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f4bb3-8e9e-4608-8bd9-7329cfdfd1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:20.823711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f4bb3-8e9e-4608-8bd9-7329cfdfd1c2 admin admin] PATH_INFO: `/v3/projects/d1cc677342be438e8561c3cfaa22264f/users/b83d802b199e410485518ca545c2dedc/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:20.842746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8a3c0-07b5-4cd0-b0c4-bd940a65ba72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:20.845730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8a3c0-07b5-4cd0-b0c4-bd940a65ba72 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:20.863379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f4bb3-8e9e-4608-8bd9-7329cfdfd1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cc677342be438e8561c3cfaa22264f, user_id=b83d802b199e410485518ca545c2dedc, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:20.866289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f4bb3-8e9e-4608-8bd9-7329cfdfd1c2 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:20.872567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 867/1729] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:20.874127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054771-7221-4400-9956-a54306bc5e50 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:20.875520 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054771-7221-4400-9956-a54306bc5e50 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:20.876311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054771-7221-4400-9956-a54306bc5e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:20.894152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 863/1730] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:20 2022] PUT /identity/v3/projects/d1cc677342be438e8561c3cfaa22264f/users/b83d802b199e410485518ca545c2dedc/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:20.895097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f4bb3-8e9e-4608-8bd9-7329cfdfd1c2 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:20.902756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5b5f4bb3-8e9e-4608-8bd9-7329cfdfd1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:20.915272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-43054771-7221-4400-9956-a54306bc5e50 None None] MFA Rules not processed for user `9c142f4d77b54982abcd4b76edbcb4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:20.917608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-43054771-7221-4400-9956-a54306bc5e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:21.103940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 868/1731] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Jun 16 00:25:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:21.110564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43054771-7221-4400-9956-a54306bc5e50 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:21.126011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f4bb3-8e9e-4608-8bd9-7329cfdfd1c2 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:21.149862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:21.151743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43054771-7221-4400-9956-a54306bc5e50 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:21.152394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:21.152848 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:21.157555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] PATH_INFO: `/v3/projects/af8d71de774d4918aa91da3437f9a89a` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:21.160459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8d71de774d4918aa91da3437f9a89a)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:21.165008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:21.170493 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7212e-f9fd-49fa-b9ba-c18a28b732b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:21.172795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7212e-f9fd-49fa-b9ba-c18a28b732b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:21.174029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7212e-f9fd-49fa-b9ba-c18a28b732b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:21.174417 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7212e-f9fd-49fa-b9ba-c18a28b732b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:21.178513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7212e-f9fd-49fa-b9ba-c18a28b732b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:21.184483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7212e-f9fd-49fa-b9ba-c18a28b732b9 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:21.225488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 869/1732] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:21.225488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7212e-f9fd-49fa-b9ba-c18a28b732b9 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:21.229383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-14e7212e-f9fd-49fa-b9ba-c18a28b732b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:21.261420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7212e-f9fd-49fa-b9ba-c18a28b732b9 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:21.278646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8d71de774d4918aa91da3437f9a89a', 'request_id': 'req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:21.294236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8d71de774d4918aa91da3437f9a89a', 'request_id': 'req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:21.304386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8d71de774d4918aa91da3437f9a89a', 'request_id': 'req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:21.332940 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] The token cache is being invalidate because project af8d71de774d4918aa91da3437f9a89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:21.333163 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:21.334185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:21.339299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 864/1733] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:20 2022] DELETE /identity/v3/projects/af8d71de774d4918aa91da3437f9a89a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:21.339299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:21.339299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:21.444466 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:21.445587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:21.446077 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:21.446381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] PATH_INFO: `/v3/projects/e048fdfb5149481285edcb1c5b4dd525` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:21.451781 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e048fdfb5149481285edcb1c5b4dd525)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:21.456127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:21.522544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a469f-b8d2-4547-9ddf-e550a03aa9c5 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:21.531779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107e85e-62eb-4bd8-8e26-ecf714afdc67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:21.532644 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107e85e-62eb-4bd8-8e26-ecf714afdc67 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:21.533158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107e85e-62eb-4bd8-8e26-ecf714afdc67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:21.535437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107e85e-62eb-4bd8-8e26-ecf714afdc67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:21.540798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3107e85e-62eb-4bd8-8e26-ecf714afdc67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:21.574351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107e85e-62eb-4bd8-8e26-ecf714afdc67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:21.577095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107e85e-62eb-4bd8-8e26-ecf714afdc67 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:21.587949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:21.595664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:21.596870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e048fdfb5149481285edcb1c5b4dd525', 'request_id': 'req-2a1aeaf3-79e1-4957-917c-808582e7c085'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:21.606504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 865/1734] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:21.608895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e0542-d5f5-4a02-b14f-cdbe8b191b7d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:21.609503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e0542-d5f5-4a02-b14f-cdbe8b191b7d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:21.610116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e0542-d5f5-4a02-b14f-cdbe8b191b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:21.614615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e048fdfb5149481285edcb1c5b4dd525', 'request_id': 'req-2a1aeaf3-79e1-4957-917c-808582e7c085'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:21.624853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e048fdfb5149481285edcb1c5b4dd525', 'request_id': 'req-2a1aeaf3-79e1-4957-917c-808582e7c085'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:21.647129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] The token cache is being invalidate because project e048fdfb5149481285edcb1c5b4dd525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:21.648453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:21.649374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:21.651112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 870/1735] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:21 2022] DELETE /identity/v3/projects/e048fdfb5149481285edcb1c5b4dd525 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:21.662397 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:21.670149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:21.721384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-3d0e0542-d5f5-4a02-b14f-cdbe8b191b7d None None] MFA Rules not processed for user `71cddd4efaaf4298934a4f601d746175`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:21.723879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3d0e0542-d5f5-4a02-b14f-cdbe8b191b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:21.953378 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 866/1736] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:21.961416 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e0542-d5f5-4a02-b14f-cdbe8b191b7d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:21.967074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3d0e0542-d5f5-4a02-b14f-cdbe8b191b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:22.071858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aeaf3-79e1-4957-917c-808582e7c085 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:22.104803 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0119ad-8469-4672-a4cd-1a88377a6f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:22.108575 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0119ad-8469-4672-a4cd-1a88377a6f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:22.108665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0119ad-8469-4672-a4cd-1a88377a6f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:22.108924 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0119ad-8469-4672-a4cd-1a88377a6f63 admin admin] PATH_INFO: `/v3/projects/d1cc677342be438e8561c3cfaa22264f/users/b83d802b199e410485518ca545c2dedc/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:22.115290 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0119ad-8469-4672-a4cd-1a88377a6f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cc677342be438e8561c3cfaa22264f, user_id=b83d802b199e410485518ca545c2dedc, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:22.124100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0119ad-8469-4672-a4cd-1a88377a6f63 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:22.174425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 871/1737] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:21 2022] PUT /identity/v3/projects/d1cc677342be438e8561c3cfaa22264f/users/b83d802b199e410485518ca545c2dedc/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:22.191318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ffa83-72e0-4ad5-a504-3566960903be None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:22.191609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ffa83-72e0-4ad5-a504-3566960903be None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:22.191891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ffa83-72e0-4ad5-a504-3566960903be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:22.272083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e25ffa83-72e0-4ad5-a504-3566960903be None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:22.274693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e0542-d5f5-4a02-b14f-cdbe8b191b7d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:22.276006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e25ffa83-72e0-4ad5-a504-3566960903be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:22.503147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 872/1738] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:22.503147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ffa83-72e0-4ad5-a504-3566960903be None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:22.505576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e25ffa83-72e0-4ad5-a504-3566960903be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:22.514018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c8076-f080-4a18-a045-c47f6cace3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:22.518281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c8076-f080-4a18-a045-c47f6cace3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:22.518753 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c8076-f080-4a18-a045-c47f6cace3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:22.519150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c8076-f080-4a18-a045-c47f6cace3bd admin admin] PATH_INFO: `/v3/users/fd9895e05f5b404e8af94418d6dd9afa` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:22.521358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c8076-f080-4a18-a045-c47f6cace3bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9895e05f5b404e8af94418d6dd9afa)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:22.526974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c8076-f080-4a18-a045-c47f6cace3bd admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:22.631209 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:22.650443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ec2c8076-f080-4a18-a045-c47f6cace3bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9895e05f5b404e8af94418d6dd9afa'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:22.681534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:22.689579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ec2c8076-f080-4a18-a045-c47f6cace3bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9895e05f5b404e8af94418d6dd9afa'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:22.690338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ffa83-72e0-4ad5-a504-3566960903be None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:22.694085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ec2c8076-f080-4a18-a045-c47f6cace3bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9895e05f5b404e8af94418d6dd9afa'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:22.703423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c926a-1b90-4020-bde0-a07389a4835b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:22.704487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c926a-1b90-4020-bde0-a07389a4835b service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:22.705335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c926a-1b90-4020-bde0-a07389a4835b service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:22.706034 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c926a-1b90-4020-bde0-a07389a4835b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:22.713754 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-168c926a-1b90-4020-bde0-a07389a4835b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:22.749421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ec2c8076-f080-4a18-a045-c47f6cace3bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9895e05f5b404e8af94418d6dd9afa'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:22.760731 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ec2c8076-f080-4a18-a045-c47f6cace3bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9895e05f5b404e8af94418d6dd9afa'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:22.779391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 867/1739] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:21 2022] DELETE /identity/v3/users/fd9895e05f5b404e8af94418d6dd9afa => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:22.785258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac6a4b-cc0e-49da-8b03-6f0c43802e37 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:22.785552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac6a4b-cc0e-49da-8b03-6f0c43802e37 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:22.785835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac6a4b-cc0e-49da-8b03-6f0c43802e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:22.909508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-9aac6a4b-cc0e-49da-8b03-6f0c43802e37 None None] MFA Rules not processed for user `b83d802b199e410485518ca545c2dedc`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:22.910765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9aac6a4b-cc0e-49da-8b03-6f0c43802e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:22.946262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c926a-1b90-4020-bde0-a07389a4835b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:22.957942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c926a-1b90-4020-bde0-a07389a4835b service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:23.002467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 873/1740] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:23.019667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229ea85-2be2-4684-bfe4-fe1fca64509a None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:23.019991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229ea85-2be2-4684-bfe4-fe1fca64509a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:23.020271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229ea85-2be2-4684-bfe4-fe1fca64509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:23.122892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-7229ea85-2be2-4684-bfe4-fe1fca64509a None None] MFA Rules not processed for user `f8dd78b473fc4b2bbe3d85471419f594`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:23.129884 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7229ea85-2be2-4684-bfe4-fe1fca64509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:23.304909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 868/1741] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:23.307197 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075509f-61d8-4bdc-9e88-6537ac927c83 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:23.307487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075509f-61d8-4bdc-9e88-6537ac927c83 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:23.307765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075509f-61d8-4bdc-9e88-6537ac927c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:23.342018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 874/1742] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:23.342974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229ea85-2be2-4684-bfe4-fe1fca64509a None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:23.344588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7229ea85-2be2-4684-bfe4-fe1fca64509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:23.359150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0075509f-61d8-4bdc-9e88-6537ac927c83 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:23.364379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0075509f-61d8-4bdc-9e88-6537ac927c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:23.494401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229ea85-2be2-4684-bfe4-fe1fca64509a None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:23.528250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995a5a8-1fed-4863-b933-abbeecad1121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:23.528936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995a5a8-1fed-4863-b933-abbeecad1121 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:23.529220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995a5a8-1fed-4863-b933-abbeecad1121 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:23.529499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995a5a8-1fed-4863-b933-abbeecad1121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:23.563489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995a5a8-1fed-4863-b933-abbeecad1121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:23.564987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995a5a8-1fed-4863-b933-abbeecad1121 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:23.605712 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 875/1743] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:23.697596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 869/1744] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:23.700809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995a5a8-1fed-4863-b933-abbeecad1121 service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:23.730062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995a5a8-1fed-4863-b933-abbeecad1121 service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:23.742107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba261a-b218-4958-a821-39de09ed0c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:23.747677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba261a-b218-4958-a821-39de09ed0c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:23.748937 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba261a-b218-4958-a821-39de09ed0c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:23.749772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba261a-b218-4958-a821-39de09ed0c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:23.753396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba261a-b218-4958-a821-39de09ed0c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:23.756033 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba261a-b218-4958-a821-39de09ed0c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:23.760798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba261a-b218-4958-a821-39de09ed0c58 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:23.811555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 876/1745] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:23.816539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075509f-61d8-4bdc-9e88-6537ac927c83 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:23.830693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075509f-61d8-4bdc-9e88-6537ac927c83 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:23.857223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a66c1-fd81-4f57-90bc-32feccc09302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:23.858515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a66c1-fd81-4f57-90bc-32feccc09302 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:23.858970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a66c1-fd81-4f57-90bc-32feccc09302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:23.860853 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a66c1-fd81-4f57-90bc-32feccc09302 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:23.861893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a66c1-fd81-4f57-90bc-32feccc09302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:23.866041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a66c1-fd81-4f57-90bc-32feccc09302 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:23.997179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 870/1746] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:23 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:24.000213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba261a-b218-4958-a821-39de09ed0c58 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:24.033503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba261a-b218-4958-a821-39de09ed0c58 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:24.169196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:24.226648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1b56e-e571-4bc2-8d47-5acd48a351fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:24.229076 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b56e-e571-4bc2-8d47-5acd48a351fb admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:24.229573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b56e-e571-4bc2-8d47-5acd48a351fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:24.229982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1b56e-e571-4bc2-8d47-5acd48a351fb admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:24.231157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1b56e-e571-4bc2-8d47-5acd48a351fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:24.234127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1b56e-e571-4bc2-8d47-5acd48a351fb admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:24.296614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a66c1-fd81-4f57-90bc-32feccc09302 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:24.309253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 877/1747] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:23 2022] POST /identity/v3/users => generated 291 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:24.313942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a66c1-fd81-4f57-90bc-32feccc09302 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:24.331261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d82169-d3de-46d0-a228-8fd4aa88b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:24.332926 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82169-d3de-46d0-a228-8fd4aa88b5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:24.333545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82169-d3de-46d0-a228-8fd4aa88b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:24.333853 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82169-d3de-46d0-a228-8fd4aa88b5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:24.334986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d82169-d3de-46d0-a228-8fd4aa88b5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:24.337344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d82169-d3de-46d0-a228-8fd4aa88b5d3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:24.365363 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1b56e-e571-4bc2-8d47-5acd48a351fb admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:24.381203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 871/1748] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:24.402548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1b56e-e571-4bc2-8d47-5acd48a351fb admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:24.422220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabfea8-05b3-4a30-a7f6-48f687e2573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:24.423328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabfea8-05b3-4a30-a7f6-48f687e2573b admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:24.423917 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabfea8-05b3-4a30-a7f6-48f687e2573b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:24.424626 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabfea8-05b3-4a30-a7f6-48f687e2573b admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:24.425872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabfea8-05b3-4a30-a7f6-48f687e2573b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:24.427861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabfea8-05b3-4a30-a7f6-48f687e2573b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:24.447953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d82169-d3de-46d0-a228-8fd4aa88b5d3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:24.462708 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 878/1749] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:24.468480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d82169-d3de-46d0-a228-8fd4aa88b5d3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:24.475617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011446eb-1ff4-4ca6-9d9a-2c5aef5dac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:24.476747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011446eb-1ff4-4ca6-9d9a-2c5aef5dac1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:24.477100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011446eb-1ff4-4ca6-9d9a-2c5aef5dac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:24.477622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011446eb-1ff4-4ca6-9d9a-2c5aef5dac1d admin admin] PATH_INFO: `/v3/projects/3d2f07b02a974084b1b0f810b0367f2b/users/233e9f89225a43e4ad02b2ea6ee1e8df/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:24.492357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:24.533397 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011446eb-1ff4-4ca6-9d9a-2c5aef5dac1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2f07b02a974084b1b0f810b0367f2b, user_id=233e9f89225a43e4ad02b2ea6ee1e8df, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:24.544137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011446eb-1ff4-4ca6-9d9a-2c5aef5dac1d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:24.556422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabfea8-05b3-4a30-a7f6-48f687e2573b admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:24.558784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6fabfea8-05b3-4a30-a7f6-48f687e2573b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:24.629446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 872/1750] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:24 2022] PUT /identity/v3/projects/3d2f07b02a974084b1b0f810b0367f2b/users/233e9f89225a43e4ad02b2ea6ee1e8df/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:24.631742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabfea8-05b3-4a30-a7f6-48f687e2573b admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:24.633931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213105a-c1ff-49ff-9c7d-5c7b5172c744 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:24.635015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213105a-c1ff-49ff-9c7d-5c7b5172c744 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:24.635379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213105a-c1ff-49ff-9c7d-5c7b5172c744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:24.723897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-6213105a-c1ff-49ff-9c7d-5c7b5172c744 None None] MFA Rules not processed for user `233e9f89225a43e4ad02b2ea6ee1e8df`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:24.726935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6213105a-c1ff-49ff-9c7d-5c7b5172c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:24.836242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d7537-2f48-4151-84c0-6991f91764f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:24.838178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7537-2f48-4151-84c0-6991f91764f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:24.838921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7537-2f48-4151-84c0-6991f91764f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:24.839477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7537-2f48-4151-84c0-6991f91764f1 admin admin] PATH_INFO: `/v3/users/dfd33d950ddb41fbab56b161fe3369a0` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:24.846420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d7537-2f48-4151-84c0-6991f91764f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd33d950ddb41fbab56b161fe3369a0)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:24.853055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d7537-2f48-4151-84c0-6991f91764f1 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:24.956566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 873/1751] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:24.957604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213105a-c1ff-49ff-9c7d-5c7b5172c744 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:24.997347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c29d7537-2f48-4151-84c0-6991f91764f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd33d950ddb41fbab56b161fe3369a0'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:25.000381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c29d7537-2f48-4151-84c0-6991f91764f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd33d950ddb41fbab56b161fe3369a0'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:25.031004 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213105a-c1ff-49ff-9c7d-5c7b5172c744 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:25.042602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1937837-3879-42ec-8a20-f4b6b7ed163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:25.044792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937837-3879-42ec-8a20-f4b6b7ed163f admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:25.045493 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937837-3879-42ec-8a20-f4b6b7ed163f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:25.045810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937837-3879-42ec-8a20-f4b6b7ed163f admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:25.046568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1937837-3879-42ec-8a20-f4b6b7ed163f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:25.049136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1937837-3879-42ec-8a20-f4b6b7ed163f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:25.057873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c29d7537-2f48-4151-84c0-6991f91764f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd33d950ddb41fbab56b161fe3369a0'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:25.058974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c29d7537-2f48-4151-84c0-6991f91764f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd33d950ddb41fbab56b161fe3369a0'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:25.073311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c29d7537-2f48-4151-84c0-6991f91764f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd33d950ddb41fbab56b161fe3369a0'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:25.111506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 879/1752] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:24 2022] DELETE /identity/v3/users/dfd33d950ddb41fbab56b161fe3369a0 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:25.117000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976b361-65ac-4d99-9d9e-1bf0fa3ec830 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:25.117377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976b361-65ac-4d99-9d9e-1bf0fa3ec830 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:25.117709 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976b361-65ac-4d99-9d9e-1bf0fa3ec830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:25.132749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 874/1753] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:24 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:25.136507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1937837-3879-42ec-8a20-f4b6b7ed163f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:25.140596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e1937837-3879-42ec-8a20-f4b6b7ed163f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:25.166700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6976b361-65ac-4d99-9d9e-1bf0fa3ec830 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:25.171883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6976b361-65ac-4d99-9d9e-1bf0fa3ec830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:25.266732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:25.344071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1937837-3879-42ec-8a20-f4b6b7ed163f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:25.357629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fa99f-2947-4b44-b6db-9bcb4407478f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:25.360740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fa99f-2947-4b44-b6db-9bcb4407478f admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:25.361174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fa99f-2947-4b44-b6db-9bcb4407478f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:25.361524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fa99f-2947-4b44-b6db-9bcb4407478f admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:25.362569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fa99f-2947-4b44-b6db-9bcb4407478f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:25.366193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69fa99f-2947-4b44-b6db-9bcb4407478f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:25.372642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 880/1754] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:25.411540 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976b361-65ac-4d99-9d9e-1bf0fa3ec830 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:25.423575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 875/1755] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:25 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:25.437565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976b361-65ac-4d99-9d9e-1bf0fa3ec830 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:25.453710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05c735-ce1e-4383-87c6-6e22e0f58c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:25.455606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05c735-ce1e-4383-87c6-6e22e0f58c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:25.455877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05c735-ce1e-4383-87c6-6e22e0f58c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:25.456201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05c735-ce1e-4383-87c6-6e22e0f58c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:25.456961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05c735-ce1e-4383-87c6-6e22e0f58c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:25.458618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05c735-ce1e-4383-87c6-6e22e0f58c83 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:25.498462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fa99f-2947-4b44-b6db-9bcb4407478f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:25.499216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c69fa99f-2947-4b44-b6db-9bcb4407478f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:25.520142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 881/1756] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:25.528778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05c735-ce1e-4383-87c6-6e22e0f58c83 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:25.597717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05c735-ce1e-4383-87c6-6e22e0f58c83 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:25.625611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42410284-411a-47ab-9d49-a39dfd06aa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:25.631808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42410284-411a-47ab-9d49-a39dfd06aa24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:25.632160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42410284-411a-47ab-9d49-a39dfd06aa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:25.632421 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42410284-411a-47ab-9d49-a39dfd06aa24 admin admin] PATH_INFO: `/v3/projects/9c7307b7a9224123bd36324cb07a34d8/users/2dc708d9bdef4b26af82e9ea19cdccd4/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:25.689379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42410284-411a-47ab-9d49-a39dfd06aa24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7307b7a9224123bd36324cb07a34d8, user_id=2dc708d9bdef4b26af82e9ea19cdccd4, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:25.697789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42410284-411a-47ab-9d49-a39dfd06aa24 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:25.705311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:25.735872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 882/1757] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:25 2022] PUT /identity/v3/projects/9c7307b7a9224123bd36324cb07a34d8/users/2dc708d9bdef4b26af82e9ea19cdccd4/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:25.750841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42410284-411a-47ab-9d49-a39dfd06aa24 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:25.752117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fa99f-2947-4b44-b6db-9bcb4407478f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:25.920456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9febc1-5702-41eb-ae3a-9d7dc3e080fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:25.921188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9febc1-5702-41eb-ae3a-9d7dc3e080fe service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:25.921500 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9febc1-5702-41eb-ae3a-9d7dc3e080fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:25.921767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9febc1-5702-41eb-ae3a-9d7dc3e080fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:25.981437 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42410284-411a-47ab-9d49-a39dfd06aa24 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:26.011241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653ce41-63b6-4589-8214-540a44f17239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:26.012526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ce41-63b6-4589-8214-540a44f17239 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:26.012969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ce41-63b6-4589-8214-540a44f17239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:26.013929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653ce41-63b6-4589-8214-540a44f17239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:26.015996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653ce41-63b6-4589-8214-540a44f17239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:26.024413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653ce41-63b6-4589-8214-540a44f17239 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:26.054461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 883/1758] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:26.058616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653ce41-63b6-4589-8214-540a44f17239 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:26.079893 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653ce41-63b6-4589-8214-540a44f17239 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:26.098536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cb970-1aff-4843-81b6-fdf61963a1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:26.102627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cb970-1aff-4843-81b6-fdf61963a1ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:26.102909 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cb970-1aff-4843-81b6-fdf61963a1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:26.103198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cb970-1aff-4843-81b6-fdf61963a1ce admin admin] PATH_INFO: `/v3/projects/9c7307b7a9224123bd36324cb07a34d8/users/2dc708d9bdef4b26af82e9ea19cdccd4/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:26.114706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cb970-1aff-4843-81b6-fdf61963a1ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7307b7a9224123bd36324cb07a34d8, user_id=2dc708d9bdef4b26af82e9ea19cdccd4, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:26.122107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cb970-1aff-4843-81b6-fdf61963a1ce admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:26.149819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 884/1759] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:26 2022] PUT /identity/v3/projects/9c7307b7a9224123bd36324cb07a34d8/users/2dc708d9bdef4b26af82e9ea19cdccd4/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:26.160189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9febc1-5702-41eb-ae3a-9d7dc3e080fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:26.161145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9febc1-5702-41eb-ae3a-9d7dc3e080fe service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:26.163361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58b44-435d-4682-afb3-1011e1953490 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:26.163660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58b44-435d-4682-afb3-1011e1953490 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:26.164032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58b44-435d-4682-afb3-1011e1953490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:26.211503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 876/1760] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 715 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:25:26.247549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e7f58b44-435d-4682-afb3-1011e1953490 None None] MFA Rules not processed for user `2dc708d9bdef4b26af82e9ea19cdccd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:26.251535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e7f58b44-435d-4682-afb3-1011e1953490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:26.458158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 885/1761] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:26.471716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9febc1-5702-41eb-ae3a-9d7dc3e080fe service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:26.474328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-1d9febc1-5702-41eb-ae3a-9d7dc3e080fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:26.723447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9febc1-5702-41eb-ae3a-9d7dc3e080fe service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:26.904777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade2418-5ec4-4076-9c18-a89bce5833ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:26.905469 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2418-5ec4-4076-9c18-a89bce5833ec service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:26.905762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2418-5ec4-4076-9c18-a89bce5833ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:26.906047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade2418-5ec4-4076-9c18-a89bce5833ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:26.936842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade2418-5ec4-4076-9c18-a89bce5833ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:26.938362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade2418-5ec4-4076-9c18-a89bce5833ec service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:26.981075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 877/1762] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:27.126736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f58b44-435d-4682-afb3-1011e1953490 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:27.145369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f58b44-435d-4682-afb3-1011e1953490 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:27.158938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40960fb-d333-4d6d-bbd5-22e76ec5c805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:27.164047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40960fb-d333-4d6d-bbd5-22e76ec5c805 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:27.164362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40960fb-d333-4d6d-bbd5-22e76ec5c805 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:27.164656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40960fb-d333-4d6d-bbd5-22e76ec5c805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:27.216197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e40960fb-d333-4d6d-bbd5-22e76ec5c805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:27.246824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:27.430397 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40960fb-d333-4d6d-bbd5-22e76ec5c805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:27.431815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40960fb-d333-4d6d-bbd5-22e76ec5c805 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:27.454903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 886/1763] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:28.455688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade2418-5ec4-4076-9c18-a89bce5833ec service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:28.461396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2ade2418-5ec4-4076-9c18-a89bce5833ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:28.498532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:28.668697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade2418-5ec4-4076-9c18-a89bce5833ec service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:28.682176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:28.683121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:28.683931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:28.684423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] PATH_INFO: `/v3/projects/c2eb5d07dc0146a2b68fb82a7dd5ed40` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:28.688155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2eb5d07dc0146a2b68fb82a7dd5ed40)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:28.690305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:28.877982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2eb5d07dc0146a2b68fb82a7dd5ed40', 'request_id': 'req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:28.896989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2eb5d07dc0146a2b68fb82a7dd5ed40', 'request_id': 'req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:28.908742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2eb5d07dc0146a2b68fb82a7dd5ed40', 'request_id': 'req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:28.932322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c4f9d-673d-438a-be7b-7ebaca78f80c None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:28.933900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c4f9d-673d-438a-be7b-7ebaca78f80c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:28.934344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c4f9d-673d-438a-be7b-7ebaca78f80c None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:28.936074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 887/1764] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:25:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:28.945913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] The token cache is being invalidate because project c2eb5d07dc0146a2b68fb82a7dd5ed40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:28.945913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:28.946512 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-18dd070c-9d25-43fa-93f2-f9dc82dad9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:28.952331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 878/1765] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:28 2022] DELETE /identity/v3/projects/c2eb5d07dc0146a2b68fb82a7dd5ed40 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:28.954029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1cc32-39fa-4021-8b12-ba5f514ab697 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:28.954331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1cc32-39fa-4021-8b12-ba5f514ab697 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:28.954613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1cc32-39fa-4021-8b12-ba5f514ab697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:28.993311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4be1cc32-39fa-4021-8b12-ba5f514ab697 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:28.994317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4be1cc32-39fa-4021-8b12-ba5f514ab697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:29.140223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 888/1766] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:29.150535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa01db-4263-4dd5-9c87-f8043c1cacfe None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:29.150829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa01db-4263-4dd5-9c87-f8043c1cacfe None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:29.151106 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa01db-4263-4dd5-9c87-f8043c1cacfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:29.192923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-cdaa01db-4263-4dd5-9c87-f8043c1cacfe None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:29.194193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-cdaa01db-4263-4dd5-9c87-f8043c1cacfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:29.218691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 879/1767] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:29.222622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1cc32-39fa-4021-8b12-ba5f514ab697 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:29.239834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1cc32-39fa-4021-8b12-ba5f514ab697 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:29.252797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3591dc7-f509-4458-b909-42da33db38c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:29.253509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3591dc7-f509-4458-b909-42da33db38c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:29.253804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3591dc7-f509-4458-b909-42da33db38c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:29.254094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3591dc7-f509-4458-b909-42da33db38c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:29.254852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3591dc7-f509-4458-b909-42da33db38c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:29.255171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3591dc7-f509-4458-b909-42da33db38c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:29.256863 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3591dc7-f509-4458-b909-42da33db38c4 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:29.288473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 889/1768] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:29.294059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa01db-4263-4dd5-9c87-f8043c1cacfe None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:29.305003 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa01db-4263-4dd5-9c87-f8043c1cacfe None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:29.316044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ddca4-1fbf-4afc-baa3-8fbae425cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:29.317033 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ddca4-1fbf-4afc-baa3-8fbae425cca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:29.317466 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ddca4-1fbf-4afc-baa3-8fbae425cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:29.318521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ddca4-1fbf-4afc-baa3-8fbae425cca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:29.319382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ddca4-1fbf-4afc-baa3-8fbae425cca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:29.321957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ddca4-1fbf-4afc-baa3-8fbae425cca8 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:29.376080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 880/1769] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:29 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:29.380205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3591dc7-f509-4458-b909-42da33db38c4 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:29.402109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3591dc7-f509-4458-b909-42da33db38c4 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:29.417981 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac9409-3de6-462e-a5a4-d58315b1ca06 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:29.418663 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac9409-3de6-462e-a5a4-d58315b1ca06 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:29.419107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac9409-3de6-462e-a5a4-d58315b1ca06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:29.474543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-04ac9409-3de6-462e-a5a4-d58315b1ca06 None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:29.482204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-04ac9409-3de6-462e-a5a4-d58315b1ca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:29.602008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32440676-e007-4908-8a81-aac027e63cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:29.602731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440676-e007-4908-8a81-aac027e63cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:29.607147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440676-e007-4908-8a81-aac027e63cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:29.607455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32440676-e007-4908-8a81-aac027e63cdb admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:29.612131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32440676-e007-4908-8a81-aac027e63cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:29.618624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32440676-e007-4908-8a81-aac027e63cdb admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:29.660328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:29.685285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 890/1770] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:29 2022] POST /identity/v3/users => generated 285 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:29.686756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32440676-e007-4908-8a81-aac027e63cdb admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:29.720243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 881/1771] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:25:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:29.738227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32440676-e007-4908-8a81-aac027e63cdb admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:29.763088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba773d6a-9b3b-46e9-9b49-eb01fd366d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:29.763796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba773d6a-9b3b-46e9-9b49-eb01fd366d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:29.764120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba773d6a-9b3b-46e9-9b49-eb01fd366d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:29.764408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba773d6a-9b3b-46e9-9b49-eb01fd366d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:29.765153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba773d6a-9b3b-46e9-9b49-eb01fd366d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:29.766834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba773d6a-9b3b-46e9-9b49-eb01fd366d66 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:29.816752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4aba1-cd86-4fa0-b488-fa43244e6c30 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:29.817055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4aba1-cd86-4fa0-b488-fa43244e6c30 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:29.817347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4aba1-cd86-4fa0-b488-fa43244e6c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:29.842949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 891/1772] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:29.843906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba773d6a-9b3b-46e9-9b49-eb01fd366d66 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:29.854024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ba773d6a-9b3b-46e9-9b49-eb01fd366d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:29.886102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba773d6a-9b3b-46e9-9b49-eb01fd366d66 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:29.899883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:29.900812 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:29.901108 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:29.901395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] PATH_INFO: `/v3/projects/d2d825ef4c8c48d9ac7c103c63c6265f` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:29.904786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d825ef4c8c48d9ac7c103c63c6265f)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:29.905173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-18b4aba1-cd86-4fa0-b488-fa43244e6c30 None None] MFA Rules not processed for user `fbc6b66ed796481abf4fdea66692f4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:29.906048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:29.906417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-18b4aba1-cd86-4fa0-b488-fa43244e6c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:29.930148 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:30.096311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 882/1773] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:30.097696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4aba1-cd86-4fa0-b488-fa43244e6c30 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:30.118837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4aba1-cd86-4fa0-b488-fa43244e6c30 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:30.124941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1b867-ed0b-4c52-8ace-fce1232d159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:30.126092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1b867-ed0b-4c52-8ace-fce1232d159e admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:30.126945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1b867-ed0b-4c52-8ace-fce1232d159e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:30.127485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1b867-ed0b-4c52-8ace-fce1232d159e admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:30.128534 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1b867-ed0b-4c52-8ace-fce1232d159e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:30.135442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1b867-ed0b-4c52-8ace-fce1232d159e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:30.156606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 883/1774] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:30.158416 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1b867-ed0b-4c52-8ace-fce1232d159e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:30.160681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-43a1b867-ed0b-4c52-8ace-fce1232d159e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:30.210394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1b867-ed0b-4c52-8ace-fce1232d159e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:30.224788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c2351-9237-4508-9193-9f1df25af794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:30.226101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c2351-9237-4508-9193-9f1df25af794 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:30.226390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c2351-9237-4508-9193-9f1df25af794 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:30.226675 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c2351-9237-4508-9193-9f1df25af794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:30.252911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c2351-9237-4508-9193-9f1df25af794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:30.254990 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c2351-9237-4508-9193-9f1df25af794 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:30.295363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 884/1775] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:30.296085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c2351-9237-4508-9193-9f1df25af794 service nova] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:30.322792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c2351-9237-4508-9193-9f1df25af794 service nova] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:30.333578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b236c25-9c3c-42e2-be20-177751e1dd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:30.334496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b236c25-9c3c-42e2-be20-177751e1dd0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:30.334867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b236c25-9c3c-42e2-be20-177751e1dd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:30.335149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b236c25-9c3c-42e2-be20-177751e1dd0d admin admin] PATH_INFO: `/v3/projects/c671f690a1ce4a25b3fe3285b8100d1d/users/f04dc047b3e34b2296e5c0aa7acbf967/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:30.375314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d825ef4c8c48d9ac7c103c63c6265f', 'request_id': 'req-577ba36c-52fa-48e2-8542-5957722b2105'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:30.378953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b236c25-9c3c-42e2-be20-177751e1dd0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c671f690a1ce4a25b3fe3285b8100d1d, user_id=f04dc047b3e34b2296e5c0aa7acbf967, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:30.383526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b236c25-9c3c-42e2-be20-177751e1dd0d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:30.391329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d825ef4c8c48d9ac7c103c63c6265f', 'request_id': 'req-577ba36c-52fa-48e2-8542-5957722b2105'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:30.398202 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d825ef4c8c48d9ac7c103c63c6265f', 'request_id': 'req-577ba36c-52fa-48e2-8542-5957722b2105'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:30.425308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 885/1776] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:30 2022] PUT /identity/v3/projects/c671f690a1ce4a25b3fe3285b8100d1d/users/f04dc047b3e34b2296e5c0aa7acbf967/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:30.426220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] The token cache is being invalidate because project d2d825ef4c8c48d9ac7c103c63c6265f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:30.426677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:30.435736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eee9b-1f85-4fb0-acb3-8b7d54a1f7e3 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:30.436657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:30.437325 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eee9b-1f85-4fb0-acb3-8b7d54a1f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:30.438855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 892/1777] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:29 2022] DELETE /identity/v3/projects/d2d825ef4c8c48d9ac7c103c63c6265f => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:30.439336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eee9b-1f85-4fb0-acb3-8b7d54a1f7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:30.442947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:30.448569 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:30.517654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-f96eee9b-1f85-4fb0-acb3-8b7d54a1f7e3 None None] MFA Rules not processed for user `f04dc047b3e34b2296e5c0aa7acbf967`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:30.519719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f96eee9b-1f85-4fb0-acb3-8b7d54a1f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:30.607821 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 886/1778] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:30.612653 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eee9b-1f85-4fb0-acb3-8b7d54a1f7e3 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:30.614691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f96eee9b-1f85-4fb0-acb3-8b7d54a1f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:30.634254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ba36c-52fa-48e2-8542-5957722b2105 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:30.724754 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:30.751878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eee9b-1f85-4fb0-acb3-8b7d54a1f7e3 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:30.774639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e5228-9e8f-4718-846a-df072ae74230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:30.775906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e5228-9e8f-4718-846a-df072ae74230 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:30.776265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e5228-9e8f-4718-846a-df072ae74230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:30.776559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e5228-9e8f-4718-846a-df072ae74230 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:30.777932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e5228-9e8f-4718-846a-df072ae74230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:30.781150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e5228-9e8f-4718-846a-df072ae74230 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:30.786081 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:30.786997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:30.787287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:30.787568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] PATH_INFO: `/v3/users/b83d802b199e410485518ca545c2dedc` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:30.791933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83d802b199e410485518ca545c2dedc)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:30.796516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:30.869373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 887/1779] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:30 2022] POST /identity/v3/projects => generated 369 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:25:30.879113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e5228-9e8f-4718-846a-df072ae74230 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:30.978230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:30.984933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83d802b199e410485518ca545c2dedc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:30.987584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83d802b199e410485518ca545c2dedc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:31.041378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83d802b199e410485518ca545c2dedc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:31.044385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83d802b199e410485518ca545c2dedc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:31.062621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83d802b199e410485518ca545c2dedc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:31.101764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 893/1780] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:30 2022] DELETE /identity/v3/users/b83d802b199e410485518ca545c2dedc => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:31.104625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e5228-9e8f-4718-846a-df072ae74230 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:31.223031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee49d3-c86d-4aa4-854e-838b4faac11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:31.223792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee49d3-c86d-4aa4-854e-838b4faac11f admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:31.224236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee49d3-c86d-4aa4-854e-838b4faac11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:31.224985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee49d3-c86d-4aa4-854e-838b4faac11f admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:31.225485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee49d3-c86d-4aa4-854e-838b4faac11f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:31.227575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee49d3-c86d-4aa4-854e-838b4faac11f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:31.274766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 888/1781] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:30 2022] POST /identity/v3/users => generated 291 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:31.277502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:31.279858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:31.320872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9be9c-e4d2-4173-996c-7d7e24b4c6de admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:31.340243 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2889e-7253-4e6b-a3a7-a57209eb4f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:31.341038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2889e-7253-4e6b-a3a7-a57209eb4f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:31.341429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2889e-7253-4e6b-a3a7-a57209eb4f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:31.341787 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2889e-7253-4e6b-a3a7-a57209eb4f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:31.343076 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2889e-7253-4e6b-a3a7-a57209eb4f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:31.351112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2889e-7253-4e6b-a3a7-a57209eb4f06 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:31.378515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 894/1782] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:31.380265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee49d3-c86d-4aa4-854e-838b4faac11f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:31.397134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee49d3-c86d-4aa4-854e-838b4faac11f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:31.408984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880875d5-f77f-4982-a6d8-22925c09d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:31.411416 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880875d5-f77f-4982-a6d8-22925c09d63f admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:31.411416 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880875d5-f77f-4982-a6d8-22925c09d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:31.412842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880875d5-f77f-4982-a6d8-22925c09d63f admin admin] PATH_INFO: `/v3/projects/c96c4af465e64e7d9732a39f2c744a5a/users/c1f7d58ac8874f9ca2d2538d2dfb52cc/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:31.452293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880875d5-f77f-4982-a6d8-22925c09d63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96c4af465e64e7d9732a39f2c744a5a, user_id=c1f7d58ac8874f9ca2d2538d2dfb52cc, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:31.455845 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880875d5-f77f-4982-a6d8-22925c09d63f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:31.488022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 889/1783] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:31 2022] PUT /identity/v3/projects/c96c4af465e64e7d9732a39f2c744a5a/users/c1f7d58ac8874f9ca2d2538d2dfb52cc/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:31.489413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2889e-7253-4e6b-a3a7-a57209eb4f06 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:31.505238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2889e-7253-4e6b-a3a7-a57209eb4f06 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:31.702850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a16cdc-65c9-4e89-94ea-913fca15c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:31.705894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a16cdc-65c9-4e89-94ea-913fca15c8bd admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:31.706804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a16cdc-65c9-4e89-94ea-913fca15c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:31.707246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a16cdc-65c9-4e89-94ea-913fca15c8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:31.708414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a16cdc-65c9-4e89-94ea-913fca15c8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:31.710670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a16cdc-65c9-4e89-94ea-913fca15c8bd admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:31.736612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 895/1784] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:31.740908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880875d5-f77f-4982-a6d8-22925c09d63f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:31.769914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880875d5-f77f-4982-a6d8-22925c09d63f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:31.784081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d691fc-c5de-419c-abf3-6d9b16dd7119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:31.785712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d691fc-c5de-419c-abf3-6d9b16dd7119 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:31.785915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d691fc-c5de-419c-abf3-6d9b16dd7119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:31.786246 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d691fc-c5de-419c-abf3-6d9b16dd7119 admin admin] PATH_INFO: `/v3/projects/c96c4af465e64e7d9732a39f2c744a5a/users/c1f7d58ac8874f9ca2d2538d2dfb52cc/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:31.789880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d691fc-c5de-419c-abf3-6d9b16dd7119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96c4af465e64e7d9732a39f2c744a5a, user_id=c1f7d58ac8874f9ca2d2538d2dfb52cc, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:31.793077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d691fc-c5de-419c-abf3-6d9b16dd7119 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:31.819309 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 890/1785] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:31 2022] PUT /identity/v3/projects/c96c4af465e64e7d9732a39f2c744a5a/users/c1f7d58ac8874f9ca2d2538d2dfb52cc/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:31.822091 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf9a24-fa35-4d69-8614-150e819644d6 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:31.822589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf9a24-fa35-4d69-8614-150e819644d6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:31.824095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf9a24-fa35-4d69-8614-150e819644d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:31.876272 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936827-68ac-4014-92a8-8c72fba48e53 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:31.876835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936827-68ac-4014-92a8-8c72fba48e53 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:31.877143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936827-68ac-4014-92a8-8c72fba48e53 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:31.878791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 891/1786] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:31.881746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-8bdf9a24-fa35-4d69-8614-150e819644d6 None None] MFA Rules not processed for user `c1f7d58ac8874f9ca2d2538d2dfb52cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:31.883098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-8bdf9a24-fa35-4d69-8614-150e819644d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:32.004049 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d051847-cff9-4498-9759-c8c000f5dd8f None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:32.005592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d051847-cff9-4498-9759-c8c000f5dd8f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:32.006054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d051847-cff9-4498-9759-c8c000f5dd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:32.061050 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 896/1787] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:31 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:32.062243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4d051847-cff9-4498-9759-c8c000f5dd8f None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:32.063624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4d051847-cff9-4498-9759-c8c000f5dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:32.073303 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf9a24-fa35-4d69-8614-150e819644d6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:32.075193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-8bdf9a24-fa35-4d69-8614-150e819644d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:32.138505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:32.171054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:32.200484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf9a24-fa35-4d69-8614-150e819644d6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:32.205626 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6bbd0-05fd-4926-993d-854d645d2da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:32.206662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6bbd0-05fd-4926-993d-854d645d2da2 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:32.207328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6bbd0-05fd-4926-993d-854d645d2da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:32.208053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6bbd0-05fd-4926-993d-854d645d2da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:32.228181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6bbd0-05fd-4926-993d-854d645d2da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:32.229725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6bbd0-05fd-4926-993d-854d645d2da2 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:32.230144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 892/1788] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:25:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:32.252095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 897/1789] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:32 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:25:32.699147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d051847-cff9-4498-9759-c8c000f5dd8f None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:32.701398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4d051847-cff9-4498-9759-c8c000f5dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:32.879027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d051847-cff9-4498-9759-c8c000f5dd8f None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:32.899658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:32.901028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:32.901318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:32.905107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] PATH_INFO: `/v3/projects/d1cc677342be438e8561c3cfaa22264f` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:32.909241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cc677342be438e8561c3cfaa22264f)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:32.911741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:32.962921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6bbd0-05fd-4926-993d-854d645d2da2 service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:32.964845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1fe6bbd0-05fd-4926-993d-854d645d2da2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:33.020988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6bbd0-05fd-4926-993d-854d645d2da2 service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:33.056801 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cc677342be438e8561c3cfaa22264f', 'request_id': 'req-cb2b57de-cc4a-411c-a602-70a336575045'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:33.084077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cc677342be438e8561c3cfaa22264f', 'request_id': 'req-cb2b57de-cc4a-411c-a602-70a336575045'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:33.093109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cc677342be438e8561c3cfaa22264f', 'request_id': 'req-cb2b57de-cc4a-411c-a602-70a336575045'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:33.127437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] The token cache is being invalidate because project d1cc677342be438e8561c3cfaa22264f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:33.127789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:33.130468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cb2b57de-cc4a-411c-a602-70a336575045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:33.139742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 893/1790] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:32 2022] DELETE /identity/v3/projects/d1cc677342be438e8561c3cfaa22264f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:33.146714 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82840e-636c-4d03-9e71-97c4518c94ea None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:33.147035 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82840e-636c-4d03-9e71-97c4518c94ea None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:33.147345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82840e-636c-4d03-9e71-97c4518c94ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:33.193915 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3aaa2e-7452-45e4-8cd3-8e3ac9f59a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:33.195007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3aaa2e-7452-45e4-8cd3-8e3ac9f59a1a service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:33.195497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3aaa2e-7452-45e4-8cd3-8e3ac9f59a1a service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:33.196041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3aaa2e-7452-45e4-8cd3-8e3ac9f59a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:33.198909 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7a3aaa2e-7452-45e4-8cd3-8e3ac9f59a1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:33.202065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0a82840e-636c-4d03-9e71-97c4518c94ea None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:33.203285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0a82840e-636c-4d03-9e71-97c4518c94ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:33.226093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3aaa2e-7452-45e4-8cd3-8e3ac9f59a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:33.238236 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3aaa2e-7452-45e4-8cd3-8e3ac9f59a1a service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:33.268459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 898/1791] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:33.323707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:33.382018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 894/1792] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:33.390167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18309720-fd48-4c12-b7cf-3a100b2dbabb None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:33.390479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18309720-fd48-4c12-b7cf-3a100b2dbabb None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:33.390785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18309720-fd48-4c12-b7cf-3a100b2dbabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:33.444637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-18309720-fd48-4c12-b7cf-3a100b2dbabb None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:33.445890 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-18309720-fd48-4c12-b7cf-3a100b2dbabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:33.492533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82840e-636c-4d03-9e71-97c4518c94ea None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:33.498662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 899/1793] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:33.511622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82840e-636c-4d03-9e71-97c4518c94ea None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:33.532768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033504-c80c-4613-a158-b718f64914a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:33.533756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033504-c80c-4613-a158-b718f64914a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:33.534331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033504-c80c-4613-a158-b718f64914a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:33.535120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033504-c80c-4613-a158-b718f64914a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:33.536198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033504-c80c-4613-a158-b718f64914a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:33.536677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033504-c80c-4613-a158-b718f64914a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:33.538465 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033504-c80c-4613-a158-b718f64914a0 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:33.584937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 895/1794] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:25:33.586941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18309720-fd48-4c12-b7cf-3a100b2dbabb None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:33.643319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18309720-fd48-4c12-b7cf-3a100b2dbabb None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:33.664146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f821d-6b20-4fac-b2a3-7c9605e933c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:33.675218 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f821d-6b20-4fac-b2a3-7c9605e933c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:33.677844 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f821d-6b20-4fac-b2a3-7c9605e933c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:33.678147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f821d-6b20-4fac-b2a3-7c9605e933c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:33.680087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f821d-6b20-4fac-b2a3-7c9605e933c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:33.697315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f821d-6b20-4fac-b2a3-7c9605e933c0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:33.815108 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 900/1795] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:33 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:33.825843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033504-c80c-4613-a158-b718f64914a0 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:33.843136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033504-c80c-4613-a158-b718f64914a0 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:33.945923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6424b-ead4-41d2-9638-bae26901a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:33.946853 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6424b-ead4-41d2-9638-bae26901a9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:33.947140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6424b-ead4-41d2-9638-bae26901a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:33.950484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6424b-ead4-41d2-9638-bae26901a9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:33.951206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6424b-ead4-41d2-9638-bae26901a9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:33.953254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6424b-ead4-41d2-9638-bae26901a9a5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:33.985914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 896/1796] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:33 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:33.990483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f821d-6b20-4fac-b2a3-7c9605e933c0 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:34.003904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f821d-6b20-4fac-b2a3-7c9605e933c0 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:34.031371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3163716-693a-4a7b-a7e8-368056c9281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:34.032141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3163716-693a-4a7b-a7e8-368056c9281b admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:34.032430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3163716-693a-4a7b-a7e8-368056c9281b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:34.032717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3163716-693a-4a7b-a7e8-368056c9281b admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:34.033485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3163716-693a-4a7b-a7e8-368056c9281b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:34.038435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3163716-693a-4a7b-a7e8-368056c9281b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:34.066328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 901/1797] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:34.070338 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6424b-ead4-41d2-9638-bae26901a9a5 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:34.096264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6424b-ead4-41d2-9638-bae26901a9a5 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:34.103188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14350e-a5fa-4e83-ba2f-d50fd9aca34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:34.104514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14350e-a5fa-4e83-ba2f-d50fd9aca34a admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:34.106366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14350e-a5fa-4e83-ba2f-d50fd9aca34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:34.107015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14350e-a5fa-4e83-ba2f-d50fd9aca34a admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:34.110952 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14350e-a5fa-4e83-ba2f-d50fd9aca34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:34.114210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14350e-a5fa-4e83-ba2f-d50fd9aca34a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:34.147450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3163716-693a-4a7b-a7e8-368056c9281b admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:34.158864 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 897/1798] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:34.170976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3163716-693a-4a7b-a7e8-368056c9281b admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:34.184749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dbc32-dabd-4b09-937d-aa67ee0815e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:34.186905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dbc32-dabd-4b09-937d-aa67ee0815e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:34.187201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dbc32-dabd-4b09-937d-aa67ee0815e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:34.187489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dbc32-dabd-4b09-937d-aa67ee0815e0 admin admin] PATH_INFO: `/v3/projects/b9abaff518c64ac4931507a07b568cf4/users/504e0d97cb1c47598c31fe07254d2c31/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:34.220127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dbc32-dabd-4b09-937d-aa67ee0815e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9abaff518c64ac4931507a07b568cf4, user_id=504e0d97cb1c47598c31fe07254d2c31, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:34.223349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dbc32-dabd-4b09-937d-aa67ee0815e0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:34.244018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 902/1799] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:34 2022] PUT /identity/v3/projects/b9abaff518c64ac4931507a07b568cf4/users/504e0d97cb1c47598c31fe07254d2c31/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:34.257615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8264c6-12df-42bc-b37f-e76c270641e0 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:34.257921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8264c6-12df-42bc-b37f-e76c270641e0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:34.258212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8264c6-12df-42bc-b37f-e76c270641e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:34.304330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2a8264c6-12df-42bc-b37f-e76c270641e0 None None] MFA Rules not processed for user `504e0d97cb1c47598c31fe07254d2c31`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:34.305820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2a8264c6-12df-42bc-b37f-e76c270641e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:34.496547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 898/1800] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:34.500872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dbc32-dabd-4b09-937d-aa67ee0815e0 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:34.634871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:34.642778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dbc32-dabd-4b09-937d-aa67ee0815e0 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:34.660402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3525596-c9f3-4684-b084-e0953998a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:34.661588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525596-c9f3-4684-b084-e0953998a9eb admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:34.662085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525596-c9f3-4684-b084-e0953998a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:34.663445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525596-c9f3-4684-b084-e0953998a9eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:34.665964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3525596-c9f3-4684-b084-e0953998a9eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:34.671349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3525596-c9f3-4684-b084-e0953998a9eb admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:34.767777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 903/1801] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:34 2022] POST /identity/v3/projects => generated 381 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:34.769298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8264c6-12df-42bc-b37f-e76c270641e0 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:34.782516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8264c6-12df-42bc-b37f-e76c270641e0 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:34.899254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:34.925701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af173279-e802-4e1e-944c-ebca708e34e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:34.926405 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af173279-e802-4e1e-944c-ebca708e34e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:34.926694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af173279-e802-4e1e-944c-ebca708e34e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:34.926978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af173279-e802-4e1e-944c-ebca708e34e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:34.927697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af173279-e802-4e1e-944c-ebca708e34e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:34.929810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af173279-e802-4e1e-944c-ebca708e34e3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:34.976350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 899/1802] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:34 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:34.976874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3525596-c9f3-4684-b084-e0953998a9eb admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:34.996414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3525596-c9f3-4684-b084-e0953998a9eb admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:35.022108 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ff2bf-9022-4eb4-bbd0-ec4a67c6c845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:35.023164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ff2bf-9022-4eb4-bbd0-ec4a67c6c845 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:35.023649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ff2bf-9022-4eb4-bbd0-ec4a67c6c845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:35.024149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ff2bf-9022-4eb4-bbd0-ec4a67c6c845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:35.026970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ff2bf-9022-4eb4-bbd0-ec4a67c6c845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:35.032301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ff2bf-9022-4eb4-bbd0-ec4a67c6c845 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:35.058450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 904/1803] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:35.062877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af173279-e802-4e1e-944c-ebca708e34e3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:35.078393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af173279-e802-4e1e-944c-ebca708e34e3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:35.090233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd60fc6-42c5-4d8b-9f67-a4bb4d47ae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:35.092834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd60fc6-42c5-4d8b-9f67-a4bb4d47ae9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:35.093349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd60fc6-42c5-4d8b-9f67-a4bb4d47ae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:35.095815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd60fc6-42c5-4d8b-9f67-a4bb4d47ae9b admin admin] PATH_INFO: `/v3/projects/1456a6b78f954c0fac6acbd5b768c632/users/bb45805065514b38a560ea253501bc9e/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:35.111456 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ff2bf-9022-4eb4-bbd0-ec4a67c6c845 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:35.113470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fe1ff2bf-9022-4eb4-bbd0-ec4a67c6c845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:35.141529 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ff2bf-9022-4eb4-bbd0-ec4a67c6c845 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:35.146611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd60fc6-42c5-4d8b-9f67-a4bb4d47ae9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1456a6b78f954c0fac6acbd5b768c632, user_id=bb45805065514b38a560ea253501bc9e, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:35.154837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd60fc6-42c5-4d8b-9f67-a4bb4d47ae9b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:35.155847 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c004c93-fbdf-46f9-b6c3-1237863007e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:35.156881 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004c93-fbdf-46f9-b6c3-1237863007e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:35.157263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004c93-fbdf-46f9-b6c3-1237863007e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:35.157624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c004c93-fbdf-46f9-b6c3-1237863007e0 admin admin] PATH_INFO: `/v3/users/f04dc047b3e34b2296e5c0aa7acbf967` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:35.160767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c004c93-fbdf-46f9-b6c3-1237863007e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04dc047b3e34b2296e5c0aa7acbf967)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:35.162850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c004c93-fbdf-46f9-b6c3-1237863007e0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:35.185160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 900/1804] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:35 2022] PUT /identity/v3/projects/1456a6b78f954c0fac6acbd5b768c632/users/bb45805065514b38a560ea253501bc9e/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:35.189232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd60fc6-42c5-4d8b-9f67-a4bb4d47ae9b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:35.274548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd60fc6-42c5-4d8b-9f67-a4bb4d47ae9b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:35.281881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb567b-78b4-48ba-b195-002513a8c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:35.282863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb567b-78b4-48ba-b195-002513a8c8be admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:35.283164 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb567b-78b4-48ba-b195-002513a8c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:35.283458 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb567b-78b4-48ba-b195-002513a8c8be admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:35.284541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb567b-78b4-48ba-b195-002513a8c8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:35.285855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8c004c93-fbdf-46f9-b6c3-1237863007e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04dc047b3e34b2296e5c0aa7acbf967'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:35.286251 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb567b-78b4-48ba-b195-002513a8c8be admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:35.287718 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8c004c93-fbdf-46f9-b6c3-1237863007e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04dc047b3e34b2296e5c0aa7acbf967'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:35.299077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 901/1805] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:35.303185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb567b-78b4-48ba-b195-002513a8c8be admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:35.314674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb567b-78b4-48ba-b195-002513a8c8be admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:35.326362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8c004c93-fbdf-46f9-b6c3-1237863007e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04dc047b3e34b2296e5c0aa7acbf967'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:35.327461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8c004c93-fbdf-46f9-b6c3-1237863007e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04dc047b3e34b2296e5c0aa7acbf967'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:35.333283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da2990-e228-42c2-a414-f1dd11588191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:35.334293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da2990-e228-42c2-a414-f1dd11588191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:35.334686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da2990-e228-42c2-a414-f1dd11588191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:35.335051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da2990-e228-42c2-a414-f1dd11588191 admin admin] PATH_INFO: `/v3/projects/1456a6b78f954c0fac6acbd5b768c632/users/bb45805065514b38a560ea253501bc9e/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:35.339147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8c004c93-fbdf-46f9-b6c3-1237863007e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04dc047b3e34b2296e5c0aa7acbf967'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:35.360703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da2990-e228-42c2-a414-f1dd11588191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1456a6b78f954c0fac6acbd5b768c632, user_id=bb45805065514b38a560ea253501bc9e, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:35.366660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da2990-e228-42c2-a414-f1dd11588191 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:35.375695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 905/1806] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:35 2022] DELETE /identity/v3/users/f04dc047b3e34b2296e5c0aa7acbf967 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:35.381067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9730bff-2bc2-43a3-983f-178b392f9a55 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:35.381651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9730bff-2bc2-43a3-983f-178b392f9a55 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:35.382154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9730bff-2bc2-43a3-983f-178b392f9a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:35.393789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 902/1807] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:35 2022] PUT /identity/v3/projects/1456a6b78f954c0fac6acbd5b768c632/users/bb45805065514b38a560ea253501bc9e/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:35.426180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c9730bff-2bc2-43a3-983f-178b392f9a55 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:35.426497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9267267-b9af-4d78-961b-9204c7a1f220 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:35.426805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9267267-b9af-4d78-961b-9204c7a1f220 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:35.427096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9267267-b9af-4d78-961b-9204c7a1f220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:35.427933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c9730bff-2bc2-43a3-983f-178b392f9a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:35.521198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-b9267267-b9af-4d78-961b-9204c7a1f220 None None] MFA Rules not processed for user `bb45805065514b38a560ea253501bc9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:35.522474 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b9267267-b9af-4d78-961b-9204c7a1f220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:35.560500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 906/1808] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:35.562355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b54e8-31cf-4aec-9d74-6c1a1a818bef None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:35.562867 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b54e8-31cf-4aec-9d74-6c1a1a818bef None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:35.563515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b54e8-31cf-4aec-9d74-6c1a1a818bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:35.614836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-353b54e8-31cf-4aec-9d74-6c1a1a818bef None None] MFA Rules not processed for user `71cddd4efaaf4298934a4f601d746175`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:35.631842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-353b54e8-31cf-4aec-9d74-6c1a1a818bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:35.731523 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:35.767816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 903/1809] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:35.767816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9267267-b9af-4d78-961b-9204c7a1f220 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:35.767816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b9267267-b9af-4d78-961b-9204c7a1f220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:35.783812 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 907/1810] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:35.785562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b54e8-31cf-4aec-9d74-6c1a1a818bef None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:35.789119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-353b54e8-31cf-4aec-9d74-6c1a1a818bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:35.815540 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:35.885518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9267267-b9af-4d78-961b-9204c7a1f220 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:35.890366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd852eab-bd9b-4243-bbff-dc2a563831cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:35.891227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd852eab-bd9b-4243-bbff-dc2a563831cd service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:35.891716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd852eab-bd9b-4243-bbff-dc2a563831cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:35.892304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd852eab-bd9b-4243-bbff-dc2a563831cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:35.912778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd852eab-bd9b-4243-bbff-dc2a563831cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:35.914301 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd852eab-bd9b-4243-bbff-dc2a563831cd service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:35.935000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 904/1811] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:35.938929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd852eab-bd9b-4243-bbff-dc2a563831cd service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:35.942621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-fd852eab-bd9b-4243-bbff-dc2a563831cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:35.943120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b54e8-31cf-4aec-9d74-6c1a1a818bef None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:35.956256 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8948d-7388-4c89-b810-22240b6109a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:35.956971 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8948d-7388-4c89-b810-22240b6109a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:35.957665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8948d-7388-4c89-b810-22240b6109a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:35.957665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8948d-7388-4c89-b810-22240b6109a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:35.961300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd852eab-bd9b-4243-bbff-dc2a563831cd service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:35.967015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:35.967917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:35.968233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:35.968510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] PATH_INFO: `/v3/users/233e9f89225a43e4ad02b2ea6ee1e8df` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:35.969752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=233e9f89225a43e4ad02b2ea6ee1e8df)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:35.971935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:35.973791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8948d-7388-4c89-b810-22240b6109a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:35.977199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8948d-7388-4c89-b810-22240b6109a1 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:36.032336 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 908/1812] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:36.065726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233e9f89225a43e4ad02b2ea6ee1e8df'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:36.090670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233e9f89225a43e4ad02b2ea6ee1e8df'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:36.091494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233e9f89225a43e4ad02b2ea6ee1e8df'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:36.103215 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233e9f89225a43e4ad02b2ea6ee1e8df'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:36.116033 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233e9f89225a43e4ad02b2ea6ee1e8df'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:36.127826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 905/1813] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:35 2022] DELETE /identity/v3/users/233e9f89225a43e4ad02b2ea6ee1e8df => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:36.129253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4d141-9059-4d28-8ebd-27e7d48aaef1 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:36.132041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4d141-9059-4d28-8ebd-27e7d48aaef1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:36.132041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4d141-9059-4d28-8ebd-27e7d48aaef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:36.161478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-d5e4d141-9059-4d28-8ebd-27e7d48aaef1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:36.162827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d5e4d141-9059-4d28-8ebd-27e7d48aaef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:36.258072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 909/1814] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:36.270903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:36.272505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:36.347625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c0b5-af9e-4eef-99e4-1b9f58923e6a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:36.351874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605ba94-88b9-4785-b5cf-863742d05de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:36.352706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605ba94-88b9-4785-b5cf-863742d05de5 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:36.353031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605ba94-88b9-4785-b5cf-863742d05de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:36.353277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605ba94-88b9-4785-b5cf-863742d05de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:36.369406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605ba94-88b9-4785-b5cf-863742d05de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:36.370887 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605ba94-88b9-4785-b5cf-863742d05de5 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:36.382208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 906/1815] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:36.512094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4d141-9059-4d28-8ebd-27e7d48aaef1 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:36.514480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d5e4d141-9059-4d28-8ebd-27e7d48aaef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:36.598480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4d141-9059-4d28-8ebd-27e7d48aaef1 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:36.604039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a9e4d-c483-4d69-a784-87d0feccfa4a tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb45805065514b38a560ea253501bc9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1456a6b78f954c0fac6acbd5b768c632', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:36.605417 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9e4d-c483-4d69-a784-87d0feccfa4a tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:36.605710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9e4d-c483-4d69-a784-87d0feccfa4a tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:36.605996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a9e4d-c483-4d69-a784-87d0feccfa4a tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:36.606743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a9e4d-c483-4d69-a784-87d0feccfa4a tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:36.607425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a9e4d-c483-4d69-a784-87d0feccfa4a tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:36.609146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a9e4d-c483-4d69-a784-87d0feccfa4a tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:36.621904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 910/1816] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:36.626096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605ba94-88b9-4785-b5cf-863742d05de5 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:36.638795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605ba94-88b9-4785-b5cf-863742d05de5 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:36.645838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25e825-4491-42d6-b898-997e5f36b7c7 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb45805065514b38a560ea253501bc9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1456a6b78f954c0fac6acbd5b768c632', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:36.646309 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25e825-4491-42d6-b898-997e5f36b7c7 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:36.646611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25e825-4491-42d6-b898-997e5f36b7c7 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:36.646899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25e825-4491-42d6-b898-997e5f36b7c7 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:36.647698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25e825-4491-42d6-b898-997e5f36b7c7 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:36.663932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25e825-4491-42d6-b898-997e5f36b7c7 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:36.700921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a9e4d-c483-4d69-a784-87d0feccfa4a tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:36.707077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 907/1817] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:36 2022] POST /identity/v3/projects => generated 355 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:36.717693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a9e4d-c483-4d69-a784-87d0feccfa4a tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:36.776089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:36.923026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9b44c-b67a-4a70-b201-16889cbf31e5 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb45805065514b38a560ea253501bc9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1456a6b78f954c0fac6acbd5b768c632', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:36.925696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9b44c-b67a-4a70-b201-16889cbf31e5 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:36.925696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9b44c-b67a-4a70-b201-16889cbf31e5 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:36.925696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9b44c-b67a-4a70-b201-16889cbf31e5 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:36.926271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9b44c-b67a-4a70-b201-16889cbf31e5 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:36.926601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9b44c-b67a-4a70-b201-16889cbf31e5 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:36.929683 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9b44c-b67a-4a70-b201-16889cbf31e5 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:36.948859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 911/1818] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:37.060686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25e825-4491-42d6-b898-997e5f36b7c7 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:37.084267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25e825-4491-42d6-b898-997e5f36b7c7 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:37.108424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb45805065514b38a560ea253501bc9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1456a6b78f954c0fac6acbd5b768c632', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:37.109341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:37.109774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:37.109970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] PATH_INFO: `/v3/projects/273d19917f4948f98bf2696d71edb1a6` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:37.114487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: Authorizing `identity:delete_project(project_id=273d19917f4948f98bf2696d71edb1a6)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:37.116496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:37.144995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:37.234281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273d19917f4948f98bf2696d71edb1a6', 'request_id': 'req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:37.278452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273d19917f4948f98bf2696d71edb1a6', 'request_id': 'req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:37.290231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273d19917f4948f98bf2696d71edb1a6', 'request_id': 'req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:37.294467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9b44c-b67a-4a70-b201-16889cbf31e5 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:37.296822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-25a9b44c-b67a-4a70-b201-16889cbf31e5 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:37.366588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] The token cache is being invalidate because project 273d19917f4948f98bf2696d71edb1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:37.366947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:37.367598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8cb5b7a-c566-42a9-943a-9b941cf3fcb6 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:37.374230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 908/1819] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:37 2022] DELETE /identity/v3/projects/273d19917f4948f98bf2696d71edb1a6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:37.588537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9b44c-b67a-4a70-b201-16889cbf31e5 tempest-VolumeQuotaClassesTest-1529875621 tempest-VolumeQuotaClassesTest-1529875621-project-admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:37.747850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d1d3-9363-462f-ade8-14619e45da0b None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:37.748200 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d1d3-9363-462f-ade8-14619e45da0b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:37.749321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d1d3-9363-462f-ade8-14619e45da0b None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:37.753425 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 909/1820] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:25:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:25:37.754764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:37.755653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:37.755941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:37.756272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] PATH_INFO: `/v3/projects/c671f690a1ce4a25b3fe3285b8100d1d` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:37.761299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c671f690a1ce4a25b3fe3285b8100d1d)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:37.773987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e6da3-653d-462d-be6c-bb664a1680e8 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:37.774427 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e6da3-653d-462d-be6c-bb664a1680e8 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:37.774635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e6da3-653d-462d-be6c-bb664a1680e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:37.782572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:37.802657 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-cc4e6da3-653d-462d-be6c-bb664a1680e8 None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:37.804392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-cc4e6da3-653d-462d-be6c-bb664a1680e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:37.927180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 910/1821] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:25:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:37.942239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c671f690a1ce4a25b3fe3285b8100d1d', 'request_id': 'req-aa76092e-2eab-4861-b2c5-8f5c436bb637'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:37.969577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c671f690a1ce4a25b3fe3285b8100d1d', 'request_id': 'req-aa76092e-2eab-4861-b2c5-8f5c436bb637'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:37.973300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e6da3-653d-462d-be6c-bb664a1680e8 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:37.975230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-cc4e6da3-653d-462d-be6c-bb664a1680e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:37.999857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c671f690a1ce4a25b3fe3285b8100d1d', 'request_id': 'req-aa76092e-2eab-4861-b2c5-8f5c436bb637'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.017818 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e6da3-653d-462d-be6c-bb664a1680e8 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:38.036492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:38.050746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] The token cache is being invalidate because project c671f690a1ce4a25b3fe3285b8100d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:38.051269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.052420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.056949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 912/1822] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:37 2022] DELETE /identity/v3/projects/c671f690a1ce4a25b3fe3285b8100d1d => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:38.064487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:38.072713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:38.199277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:38.201085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:38.201249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76092e-2eab-4861-b2c5-8f5c436bb637 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:38.201793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:38.202303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] PATH_INFO: `/v3/users/504e0d97cb1c47598c31fe07254d2c31` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:38.203693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=504e0d97cb1c47598c31fe07254d2c31)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:38.208006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:38.209779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:38.210191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:38.210590 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] PATH_INFO: `/v3/users/c1f7d58ac8874f9ca2d2538d2dfb52cc` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:38.212013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f7d58ac8874f9ca2d2538d2dfb52cc)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:38.212379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:38.214717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:38.285118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:38.290806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f7d58ac8874f9ca2d2538d2dfb52cc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.291664 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f7d58ac8874f9ca2d2538d2dfb52cc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.306179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504e0d97cb1c47598c31fe07254d2c31'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.312191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f7d58ac8874f9ca2d2538d2dfb52cc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.313017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f7d58ac8874f9ca2d2538d2dfb52cc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.325295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504e0d97cb1c47598c31fe07254d2c31'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.326287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504e0d97cb1c47598c31fe07254d2c31'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.326651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f7d58ac8874f9ca2d2538d2dfb52cc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.337400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504e0d97cb1c47598c31fe07254d2c31'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.346438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504e0d97cb1c47598c31fe07254d2c31'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.349831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 913/1823] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:38 2022] DELETE /identity/v3/users/c1f7d58ac8874f9ca2d2538d2dfb52cc => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:38.349831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:38.349831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:38.360550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 911/1824] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:37 2022] DELETE /identity/v3/users/504e0d97cb1c47598c31fe07254d2c31 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:38.364408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:38.366122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:38.439946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb6c42-cfee-43cf-8f19-c3d3ebccb519 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:38.474784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:38.490432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce33137-853e-4306-a956-76d7b9be56d9 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:38.499689 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c259a-b796-4ea5-be47-eb4677bb76c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:38.500868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c259a-b796-4ea5-be47-eb4677bb76c9 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:38.501402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c259a-b796-4ea5-be47-eb4677bb76c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:38.501911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c259a-b796-4ea5-be47-eb4677bb76c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:38.504599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4b2c259a-b796-4ea5-be47-eb4677bb76c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:38.522396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c259a-b796-4ea5-be47-eb4677bb76c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:38.526132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c259a-b796-4ea5-be47-eb4677bb76c9 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:38.541985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:38.542886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:38.543179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:38.543468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] PATH_INFO: `/v3/projects/3d2f07b02a974084b1b0f810b0367f2b` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:38.547582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 912/1825] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:38.549351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f22f-81a2-4d7f-8114-2d47bbe1d884 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:38.549759 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f22f-81a2-4d7f-8114-2d47bbe1d884 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:38.550225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2f07b02a974084b1b0f810b0367f2b)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:38.551193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f22f-81a2-4d7f-8114-2d47bbe1d884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:38.562859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:38.586208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-5d84f22f-81a2-4d7f-8114-2d47bbe1d884 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:38.589785 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5d84f22f-81a2-4d7f-8114-2d47bbe1d884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:38.607150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 913/1826] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:38.647957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84f22f-81a2-4d7f-8114-2d47bbe1d884 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:38.650721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5d84f22f-81a2-4d7f-8114-2d47bbe1d884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:38.684675 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2f07b02a974084b1b0f810b0367f2b', 'request_id': 'req-175792b9-add6-44bb-b152-cd950813306a'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.699591 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2f07b02a974084b1b0f810b0367f2b', 'request_id': 'req-175792b9-add6-44bb-b152-cd950813306a'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.715238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2f07b02a974084b1b0f810b0367f2b', 'request_id': 'req-175792b9-add6-44bb-b152-cd950813306a'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.750607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] The token cache is being invalidate because project 3d2f07b02a974084b1b0f810b0367f2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:38.750901 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.752669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:38.755041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 914/1827] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:38 2022] DELETE /identity/v3/projects/3d2f07b02a974084b1b0f810b0367f2b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:38.763656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:38.767424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:38.806697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84f22f-81a2-4d7f-8114-2d47bbe1d884 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:38.922074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:38.938533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a91c0c-ec8f-4a3a-b43e-6bcf4ae779ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:38.938533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a91c0c-ec8f-4a3a-b43e-6bcf4ae779ba service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:38.938533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a91c0c-ec8f-4a3a-b43e-6bcf4ae779ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:38.938533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a91c0c-ec8f-4a3a-b43e-6bcf4ae779ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:38.954481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-08a91c0c-ec8f-4a3a-b43e-6bcf4ae779ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:39.006045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175792b9-add6-44bb-b152-cd950813306a admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:39.012823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:39.014408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:39.014713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:39.014991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] PATH_INFO: `/v3/users/2dc708d9bdef4b26af82e9ea19cdccd4` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:39.016326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc708d9bdef4b26af82e9ea19cdccd4)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:39.018299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:39.100017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc708d9bdef4b26af82e9ea19cdccd4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:39.100708 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc708d9bdef4b26af82e9ea19cdccd4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:39.113742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:39.123658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc708d9bdef4b26af82e9ea19cdccd4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:39.125127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc708d9bdef4b26af82e9ea19cdccd4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:39.146140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc708d9bdef4b26af82e9ea19cdccd4'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:39.161836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a91c0c-ec8f-4a3a-b43e-6bcf4ae779ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:39.164662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a91c0c-ec8f-4a3a-b43e-6bcf4ae779ba service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:39.176010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 915/1828] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:38 2022] DELETE /identity/v3/users/2dc708d9bdef4b26af82e9ea19cdccd4 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:39.182878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 914/1829] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:25:39.232010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:39.234090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:39.348471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ef2d0-e985-4a27-aa73-f9066f63852d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:39.356354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:39.357383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:39.358178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:39.358460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] PATH_INFO: `/v3/projects/c96c4af465e64e7d9732a39f2c744a5a` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:39.360855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96c4af465e64e7d9732a39f2c744a5a)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:39.374278 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:39.452258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96c4af465e64e7d9732a39f2c744a5a', 'request_id': 'req-d9bcd781-9c38-495c-a8f8-519f6807cd15'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:39.465579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96c4af465e64e7d9732a39f2c744a5a', 'request_id': 'req-d9bcd781-9c38-495c-a8f8-519f6807cd15'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:39.476252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96c4af465e64e7d9732a39f2c744a5a', 'request_id': 'req-d9bcd781-9c38-495c-a8f8-519f6807cd15'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:39.498162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] The token cache is being invalidate because project c96c4af465e64e7d9732a39f2c744a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:39.498803 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:39.500051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d9bcd781-9c38-495c-a8f8-519f6807cd15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:39.502498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 916/1830] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:39 2022] DELETE /identity/v3/projects/c96c4af465e64e7d9732a39f2c744a5a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:39.508229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3e265-6a44-4d1e-b801-9bd081794338 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:39.508784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3e265-6a44-4d1e-b801-9bd081794338 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:39.508863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3e265-6a44-4d1e-b801-9bd081794338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:39.543916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-6bc3e265-6a44-4d1e-b801-9bd081794338 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:39.546479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6bc3e265-6a44-4d1e-b801-9bd081794338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:39.741855 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 915/1831] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:39.750772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582fb92-4ef3-427d-8a99-3be8f0fd20f5 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:39.751121 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582fb92-4ef3-427d-8a99-3be8f0fd20f5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:39.751328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582fb92-4ef3-427d-8a99-3be8f0fd20f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:39.779451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-1582fb92-4ef3-427d-8a99-3be8f0fd20f5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:39.780978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1582fb92-4ef3-427d-8a99-3be8f0fd20f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:39.793981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 917/1832] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:39.794329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3e265-6a44-4d1e-b801-9bd081794338 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:39.806104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3e265-6a44-4d1e-b801-9bd081794338 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:39.813567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bee9d-9d01-4530-bf31-a7526a1a0a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:39.814286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bee9d-9d01-4530-bf31-a7526a1a0a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:39.814582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bee9d-9d01-4530-bf31-a7526a1a0a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:39.815773 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bee9d-9d01-4530-bf31-a7526a1a0a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:39.816587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bee9d-9d01-4530-bf31-a7526a1a0a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:39.816916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bee9d-9d01-4530-bf31-a7526a1a0a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:39.819010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bee9d-9d01-4530-bf31-a7526a1a0a24 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:39.835144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 916/1833] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:39.839877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582fb92-4ef3-427d-8a99-3be8f0fd20f5 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:39.851246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582fb92-4ef3-427d-8a99-3be8f0fd20f5 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:39.857397 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2f333-b7ba-4682-98b0-d480612e24b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:39.858675 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f333-b7ba-4682-98b0-d480612e24b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:39.859102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f333-b7ba-4682-98b0-d480612e24b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:39.859442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2f333-b7ba-4682-98b0-d480612e24b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:39.860584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2f333-b7ba-4682-98b0-d480612e24b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:39.864963 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2f333-b7ba-4682-98b0-d480612e24b0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:39.911729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 918/1834] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:39 2022] POST /identity/v3/projects => generated 393 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:39.912677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bee9d-9d01-4530-bf31-a7526a1a0a24 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:39.923413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bee9d-9d01-4530-bf31-a7526a1a0a24 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:40.044438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ae77a-c420-42ee-a733-fe097af73c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:40.045211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ae77a-c420-42ee-a733-fe097af73c61 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:40.045512 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ae77a-c420-42ee-a733-fe097af73c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:40.045794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ae77a-c420-42ee-a733-fe097af73c61 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:40.046515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ae77a-c420-42ee-a733-fe097af73c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:40.048568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ae77a-c420-42ee-a733-fe097af73c61 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:40.087132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 917/1835] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:39 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:25:40.091912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2f333-b7ba-4682-98b0-d480612e24b0 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:40.108094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2f333-b7ba-4682-98b0-d480612e24b0 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:40.115761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d38689-5222-466f-9ade-a0dace1d37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:40.116812 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38689-5222-466f-9ade-a0dace1d37be admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:40.117245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38689-5222-466f-9ade-a0dace1d37be admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:40.117661 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38689-5222-466f-9ade-a0dace1d37be admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:40.118655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d38689-5222-466f-9ade-a0dace1d37be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:40.124229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d38689-5222-466f-9ade-a0dace1d37be admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:40.151423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 919/1836] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:40.152062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ae77a-c420-42ee-a733-fe097af73c61 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:40.166184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ae77a-c420-42ee-a733-fe097af73c61 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:40.173687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930884e4-ae0a-4c75-8d4b-d833753cd83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:40.174612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930884e4-ae0a-4c75-8d4b-d833753cd83a admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:40.175075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930884e4-ae0a-4c75-8d4b-d833753cd83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:40.176040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930884e4-ae0a-4c75-8d4b-d833753cd83a admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:40.176958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930884e4-ae0a-4c75-8d4b-d833753cd83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:40.179096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930884e4-ae0a-4c75-8d4b-d833753cd83a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:40.197843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 918/1837] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:40.199602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d38689-5222-466f-9ade-a0dace1d37be admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:40.225734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d38689-5222-466f-9ade-a0dace1d37be admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:40.233114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c83180-d4cd-4cb6-a71e-1861c943e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:40.234366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c83180-d4cd-4cb6-a71e-1861c943e8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:40.236068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c83180-d4cd-4cb6-a71e-1861c943e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:40.236517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c83180-d4cd-4cb6-a71e-1861c943e8f1 admin admin] PATH_INFO: `/v3/projects/f598ca1bb43d452fbe51ac5e0520c0de/users/1e60fd6140a04286bf365379872856aa/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:40.254595 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c83180-d4cd-4cb6-a71e-1861c943e8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f598ca1bb43d452fbe51ac5e0520c0de, user_id=1e60fd6140a04286bf365379872856aa, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:40.257714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c83180-d4cd-4cb6-a71e-1861c943e8f1 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:40.269377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:40.275484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 920/1838] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:40 2022] PUT /identity/v3/projects/f598ca1bb43d452fbe51ac5e0520c0de/users/1e60fd6140a04286bf365379872856aa/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:40.286491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4634ec-2ad3-4e53-9829-0f2fca93adb2 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:40.286787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4634ec-2ad3-4e53-9829-0f2fca93adb2 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:40.287089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4634ec-2ad3-4e53-9829-0f2fca93adb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:40.293586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:40.325520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-5a4634ec-2ad3-4e53-9829-0f2fca93adb2 None None] MFA Rules not processed for user `1e60fd6140a04286bf365379872856aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:40.326890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5a4634ec-2ad3-4e53-9829-0f2fca93adb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:40.425806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 919/1839] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:40.430258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c83180-d4cd-4cb6-a71e-1861c943e8f1 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:40.556759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c83180-d4cd-4cb6-a71e-1861c943e8f1 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:40.565791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056b517-4ea6-4ac3-bbe1-2bad22fd08b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:40.566879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056b517-4ea6-4ac3-bbe1-2bad22fd08b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:40.567262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056b517-4ea6-4ac3-bbe1-2bad22fd08b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:40.567638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056b517-4ea6-4ac3-bbe1-2bad22fd08b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:40.568486 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056b517-4ea6-4ac3-bbe1-2bad22fd08b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:40.570526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056b517-4ea6-4ac3-bbe1-2bad22fd08b5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:40.603709 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 921/1840] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:40 2022] POST /identity/v3/projects => generated 393 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:40.608103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4634ec-2ad3-4e53-9829-0f2fca93adb2 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:40.624329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056b517-4ea6-4ac3-bbe1-2bad22fd08b5 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:40.626178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4634ec-2ad3-4e53-9829-0f2fca93adb2 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:40.626813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e056b517-4ea6-4ac3-bbe1-2bad22fd08b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:40.748586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d69d9-4a8e-4ff2-9f42-9744a1571ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:40.758871 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d69d9-4a8e-4ff2-9f42-9744a1571ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:40.759319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d69d9-4a8e-4ff2-9f42-9744a1571ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:40.759610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d69d9-4a8e-4ff2-9f42-9744a1571ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:40.760486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d69d9-4a8e-4ff2-9f42-9744a1571ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:40.764917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d69d9-4a8e-4ff2-9f42-9744a1571ef1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:40.796487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 920/1841] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:40 2022] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:25:40.801968 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d69d9-4a8e-4ff2-9f42-9744a1571ef1 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:40.815587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d69d9-4a8e-4ff2-9f42-9744a1571ef1 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:40.822072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d54a8-0e97-44f7-b2c0-5fd9d301b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:40.822812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d54a8-0e97-44f7-b2c0-5fd9d301b05a admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:40.823121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d54a8-0e97-44f7-b2c0-5fd9d301b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:40.823408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d54a8-0e97-44f7-b2c0-5fd9d301b05a admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:40.824237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d54a8-0e97-44f7-b2c0-5fd9d301b05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:40.826706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d54a8-0e97-44f7-b2c0-5fd9d301b05a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:40.838350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056b517-4ea6-4ac3-bbe1-2bad22fd08b5 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:40.847509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 921/1842] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:40.847509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d54a8-0e97-44f7-b2c0-5fd9d301b05a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:40.849761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5b9d54a8-0e97-44f7-b2c0-5fd9d301b05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:40.857465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:40.860889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:40.861360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:40.864062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] PATH_INFO: `/v3/projects/9c7307b7a9224123bd36324cb07a34d8` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:40.866900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7307b7a9224123bd36324cb07a34d8)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:40.874852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:40.903819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d54a8-0e97-44f7-b2c0-5fd9d301b05a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:40.913246 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:40.914849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:40.915885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:40.916503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] PATH_INFO: `/v3/projects/b9abaff518c64ac4931507a07b568cf4` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:40.919818 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9abaff518c64ac4931507a07b568cf4)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:40.925549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:40.988643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9abaff518c64ac4931507a07b568cf4', 'request_id': 'req-2d1958a0-907e-41c6-a8fb-dd8979e78302'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.002563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9abaff518c64ac4931507a07b568cf4', 'request_id': 'req-2d1958a0-907e-41c6-a8fb-dd8979e78302'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.012367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9abaff518c64ac4931507a07b568cf4', 'request_id': 'req-2d1958a0-907e-41c6-a8fb-dd8979e78302'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.029231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7307b7a9224123bd36324cb07a34d8', 'request_id': 'req-d91a91dd-eefd-477a-871c-1416c46acff1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.031430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:41.047893 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7307b7a9224123bd36324cb07a34d8', 'request_id': 'req-d91a91dd-eefd-477a-871c-1416c46acff1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.056681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7307b7a9224123bd36324cb07a34d8', 'request_id': 'req-d91a91dd-eefd-477a-871c-1416c46acff1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.063612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] The token cache is being invalidate because project b9abaff518c64ac4931507a07b568cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:41.066588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.070124 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.076322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 922/1843] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:40 2022] DELETE /identity/v3/projects/b9abaff518c64ac4931507a07b568cf4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:41.077223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:41.083858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:41.099241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] The token cache is being invalidate because project 9c7307b7a9224123bd36324cb07a34d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:41.099541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.102704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.110123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 922/1844] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:40 2022] DELETE /identity/v3/projects/9c7307b7a9224123bd36324cb07a34d8 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:41.114305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:41.117931 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:41.188371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:41.290837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1958a0-907e-41c6-a8fb-dd8979e78302 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:41.302075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9619db-dab4-4b26-9531-063ee7566433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:41.303299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9619db-dab4-4b26-9531-063ee7566433 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:41.303597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9619db-dab4-4b26-9531-063ee7566433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:41.305117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9619db-dab4-4b26-9531-063ee7566433 admin admin] PATH_INFO: `/v3/projects/7ed972956c2f43f3b48dd1c50508faf3/users/d0ef8c4df74049b2aedc627b2397e1fe/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:41.311278 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a91dd-eefd-477a-871c-1416c46acff1 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:41.324433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:41.327594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:41.328321 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:41.330268 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] PATH_INFO: `/v3/users/bb45805065514b38a560ea253501bc9e` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:41.331913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb45805065514b38a560ea253501bc9e)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:41.336079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:41.345956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9619db-dab4-4b26-9531-063ee7566433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed972956c2f43f3b48dd1c50508faf3, user_id=d0ef8c4df74049b2aedc627b2397e1fe, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:41.364639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9619db-dab4-4b26-9531-063ee7566433 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:41.394292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 923/1845] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:41 2022] PUT /identity/v3/projects/7ed972956c2f43f3b48dd1c50508faf3/users/d0ef8c4df74049b2aedc627b2397e1fe/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:41.398808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a0f49-70aa-42bd-9402-2cba745b9060 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:41.401292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a0f49-70aa-42bd-9402-2cba745b9060 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:41.402405 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a0f49-70aa-42bd-9402-2cba745b9060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:41.445650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-350a0f49-70aa-42bd-9402-2cba745b9060 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:41.451063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-350a0f49-70aa-42bd-9402-2cba745b9060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:41.460622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb45805065514b38a560ea253501bc9e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.461809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb45805065514b38a560ea253501bc9e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.509849 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb45805065514b38a560ea253501bc9e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.516554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb45805065514b38a560ea253501bc9e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.539510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb45805065514b38a560ea253501bc9e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:41.569323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 923/1846] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:41 2022] DELETE /identity/v3/users/bb45805065514b38a560ea253501bc9e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:41.589333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:41.597515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:41.763742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48a224-d557-45ee-a512-d45babee3907 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:41.770801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aef48-7f62-4ec2-b710-13d0a2b7773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:41.772216 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aef48-7f62-4ec2-b710-13d0a2b7773c admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:41.772815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aef48-7f62-4ec2-b710-13d0a2b7773c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:41.773198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266aef48-7f62-4ec2-b710-13d0a2b7773c admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:41.774058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266aef48-7f62-4ec2-b710-13d0a2b7773c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:41.776690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266aef48-7f62-4ec2-b710-13d0a2b7773c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:41.798075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 924/1847] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:41.803240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aef48-7f62-4ec2-b710-13d0a2b7773c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:41.814518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 924/1848] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:41.823285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507273d2-0ae3-4d36-9d66-0f66f83cb1e1 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:41.823806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507273d2-0ae3-4d36-9d66-0f66f83cb1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:41.824322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507273d2-0ae3-4d36-9d66-0f66f83cb1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:41.829845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266aef48-7f62-4ec2-b710-13d0a2b7773c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:41.835614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e2dd3-362b-4077-9222-d41baed516de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:41.837136 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2dd3-362b-4077-9222-d41baed516de admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:41.837806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2dd3-362b-4077-9222-d41baed516de admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:41.838310 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e2dd3-362b-4077-9222-d41baed516de admin admin] PATH_INFO: `/v3/projects/7ed972956c2f43f3b48dd1c50508faf3/users/d0ef8c4df74049b2aedc627b2397e1fe/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:41.841738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e2dd3-362b-4077-9222-d41baed516de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed972956c2f43f3b48dd1c50508faf3, user_id=d0ef8c4df74049b2aedc627b2397e1fe, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:41.845297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e2dd3-362b-4077-9222-d41baed516de admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:41.870160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-507273d2-0ae3-4d36-9d66-0f66f83cb1e1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:41.870160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-507273d2-0ae3-4d36-9d66-0f66f83cb1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:41.876128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 925/1849] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:41 2022] PUT /identity/v3/projects/7ed972956c2f43f3b48dd1c50508faf3/users/d0ef8c4df74049b2aedc627b2397e1fe/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:41.881465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2fe19-cc29-4d66-812d-695503797cb4 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:41.881690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2fe19-cc29-4d66-812d-695503797cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:41.881979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2fe19-cc29-4d66-812d-695503797cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:41.950870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b2e2fe19-cc29-4d66-812d-695503797cb4 None None] MFA Rules not processed for user `d0ef8c4df74049b2aedc627b2397e1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:41.952147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b2e2fe19-cc29-4d66-812d-695503797cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:41.960655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:42.038264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 925/1850] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:42.039304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507273d2-0ae3-4d36-9d66-0f66f83cb1e1 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:42.048951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507273d2-0ae3-4d36-9d66-0f66f83cb1e1 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:42.064436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4066380-4b55-489d-bb00-2371b380ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:42.065136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4066380-4b55-489d-bb00-2371b380ae25 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.065419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4066380-4b55-489d-bb00-2371b380ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.065694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4066380-4b55-489d-bb00-2371b380ae25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.066440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4066380-4b55-489d-bb00-2371b380ae25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:42.066752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4066380-4b55-489d-bb00-2371b380ae25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:42.068401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4066380-4b55-489d-bb00-2371b380ae25 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:42.091132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 926/1851] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:42.096085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4066380-4b55-489d-bb00-2371b380ae25 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:42.112056 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 926/1852] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:42.113698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:42.120910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4066380-4b55-489d-bb00-2371b380ae25 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:42.128120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e0b5b-12b4-433d-8616-3dca403b8aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:42.129393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0b5b-12b4-433d-8616-3dca403b8aec admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.129753 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0b5b-12b4-433d-8616-3dca403b8aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.130108 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e0b5b-12b4-433d-8616-3dca403b8aec admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.133395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2fe19-cc29-4d66-812d-695503797cb4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:42.136427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b2e2fe19-cc29-4d66-812d-695503797cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:42.139566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e0b5b-12b4-433d-8616-3dca403b8aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:42.143225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e0b5b-12b4-433d-8616-3dca403b8aec admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:42.237981 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 927/1853] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:42 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:42.248064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e0b5b-12b4-433d-8616-3dca403b8aec admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:42.256685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2fe19-cc29-4d66-812d-695503797cb4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:42.380579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916e737-7465-4770-ab42-2ce618b21e01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:42.381243 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916e737-7465-4770-ab42-2ce618b21e01 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.381620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916e737-7465-4770-ab42-2ce618b21e01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.381905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916e737-7465-4770-ab42-2ce618b21e01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.397105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e0b5b-12b4-433d-8616-3dca403b8aec admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:42.409341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a72c9d-b67d-443c-a4c1-f78994d66052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:42.410855 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a72c9d-b67d-443c-a4c1-f78994d66052 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.411140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a72c9d-b67d-443c-a4c1-f78994d66052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.411419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a72c9d-b67d-443c-a4c1-f78994d66052 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.412349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a72c9d-b67d-443c-a4c1-f78994d66052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:42.415051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a72c9d-b67d-443c-a4c1-f78994d66052 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:42.451460 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 928/1854] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:42 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:42.452476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a72c9d-b67d-443c-a4c1-f78994d66052 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:42.454403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e7a72c9d-b67d-443c-a4c1-f78994d66052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:42.468091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a72c9d-b67d-443c-a4c1-f78994d66052 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:42.474133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:42.475001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.475282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.476001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] PATH_INFO: `/v3/projects/1456a6b78f954c0fac6acbd5b768c632` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.476916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1456a6b78f954c0fac6acbd5b768c632)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:42.477242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916e737-7465-4770-ab42-2ce618b21e01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:42.478759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916e737-7465-4770-ab42-2ce618b21e01 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:42.479026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:42.502900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 927/1855] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:42.504169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916e737-7465-4770-ab42-2ce618b21e01 service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:42.516042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916e737-7465-4770-ab42-2ce618b21e01 service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:42.523597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b280aed-80bc-4867-91fb-404bd52bdea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:42.524720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280aed-80bc-4867-91fb-404bd52bdea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.525150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280aed-80bc-4867-91fb-404bd52bdea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.525572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b280aed-80bc-4867-91fb-404bd52bdea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.527025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b280aed-80bc-4867-91fb-404bd52bdea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:42.529481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b280aed-80bc-4867-91fb-404bd52bdea8 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:42.533949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:42.550635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 928/1856] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:42.553094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b280aed-80bc-4867-91fb-404bd52bdea8 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:42.577255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b280aed-80bc-4867-91fb-404bd52bdea8 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:42.577445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1456a6b78f954c0fac6acbd5b768c632', 'request_id': 'req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:42.582191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1456a6b78f954c0fac6acbd5b768c632', 'request_id': 'req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:42.587943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1456a6b78f954c0fac6acbd5b768c632', 'request_id': 'req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:42.600277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] The token cache is being invalidate because project 1456a6b78f954c0fac6acbd5b768c632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:42.600692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:42.601348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:42.602912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 929/1857] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:42 2022] DELETE /identity/v3/projects/1456a6b78f954c0fac6acbd5b768c632 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:42.603737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:42.605145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:42.631581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a17780-024a-412f-97e8-e3757dbd49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:42.632668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17780-024a-412f-97e8-e3757dbd49d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.632956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17780-024a-412f-97e8-e3757dbd49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.633255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a17780-024a-412f-97e8-e3757dbd49d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.634369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17780-024a-412f-97e8-e3757dbd49d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:42.636570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a17780-024a-412f-97e8-e3757dbd49d9 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:42.646484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 929/1858] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:42.647724 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fa65c-22d9-4295-a519-0daa43e50df6 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.648036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fa65c-22d9-4295-a519-0daa43e50df6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.648319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fa65c-22d9-4295-a519-0daa43e50df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.666776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-fc7fa65c-22d9-4295-a519-0daa43e50df6 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:42.668020 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fc7fa65c-22d9-4295-a519-0daa43e50df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:42.669201 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ef452-edb7-4f1e-8628-b1e7e1bd815d admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:42.672796 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a88149-3cb3-407b-bc58-2b93d8f33eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:42.673480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a88149-3cb3-407b-bc58-2b93d8f33eca service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.673766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a88149-3cb3-407b-bc58-2b93d8f33eca service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.674045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a88149-3cb3-407b-bc58-2b93d8f33eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.676056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-91a88149-3cb3-407b-bc58-2b93d8f33eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:42.676171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 930/1859] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:42.676874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fa65c-22d9-4295-a519-0daa43e50df6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:42.678190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fc7fa65c-22d9-4295-a519-0daa43e50df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:42.690652 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fa65c-22d9-4295-a519-0daa43e50df6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:42.690882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:42.695639 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354ae94-290c-4518-990a-512f1e5fbf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:42.696588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ae94-290c-4518-990a-512f1e5fbf13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.696895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ae94-290c-4518-990a-512f1e5fbf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.697170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ae94-290c-4518-990a-512f1e5fbf13 admin admin] PATH_INFO: `/v3/projects/125f31b094c043a38b9572d62fd7e5dd/users/aa4ff3f3e1484e16a7aa1ed567432a8b/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.713321 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354ae94-290c-4518-990a-512f1e5fbf13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125f31b094c043a38b9572d62fd7e5dd, user_id=aa4ff3f3e1484e16a7aa1ed567432a8b, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:42.716804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354ae94-290c-4518-990a-512f1e5fbf13 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:42.748811 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 931/1860] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:42 2022] PUT /identity/v3/projects/125f31b094c043a38b9572d62fd7e5dd/users/aa4ff3f3e1484e16a7aa1ed567432a8b/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:42.750831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a91b-c4fe-4eac-be3f-a8bef0411a69 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.751273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a91b-c4fe-4eac-be3f-a8bef0411a69 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.751864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92a91b-c4fe-4eac-be3f-a8bef0411a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.770008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-2c92a91b-c4fe-4eac-be3f-a8bef0411a69 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:42.770646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a88149-3cb3-407b-bc58-2b93d8f33eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:42.771395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-2c92a91b-c4fe-4eac-be3f-a8bef0411a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:42.772138 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a88149-3cb3-407b-bc58-2b93d8f33eca service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:42.794599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 930/1861] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:42.798716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a15d25-ef42-48a3-9ac5-94930bfda466 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.812762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a15d25-ef42-48a3-9ac5-94930bfda466 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.812762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a15d25-ef42-48a3-9ac5-94930bfda466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.905312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-57a15d25-ef42-48a3-9ac5-94930bfda466 None None] MFA Rules not processed for user `aa4ff3f3e1484e16a7aa1ed567432a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:42.906597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 932/1862] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:42.907560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92a91b-c4fe-4eac-be3f-a8bef0411a69 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:42.908951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-57a15d25-ef42-48a3-9ac5-94930bfda466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:42.919517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92a91b-c4fe-4eac-be3f-a8bef0411a69 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:42.931279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ffce9-a6b7-4402-a84e-14b440d3d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:42.935470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffce9-a6b7-4402-a84e-14b440d3d876 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:42.935773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffce9-a6b7-4402-a84e-14b440d3d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:42.936538 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffce9-a6b7-4402-a84e-14b440d3d876 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:42.938804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ffce9-a6b7-4402-a84e-14b440d3d876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:42.940595 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ffce9-a6b7-4402-a84e-14b440d3d876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:42.944048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ffce9-a6b7-4402-a84e-14b440d3d876 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:42.986123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 933/1863] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:42.988330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ffce9-a6b7-4402-a84e-14b440d3d876 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.018889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ffce9-a6b7-4402-a84e-14b440d3d876 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.033649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafabc70-dc7c-4582-82dd-dfc3281690ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.034257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafabc70-dc7c-4582-82dd-dfc3281690ad admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.034545 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafabc70-dc7c-4582-82dd-dfc3281690ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.034834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafabc70-dc7c-4582-82dd-dfc3281690ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.035828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafabc70-dc7c-4582-82dd-dfc3281690ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.044270 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafabc70-dc7c-4582-82dd-dfc3281690ad admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.071306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 931/1864] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:43.076619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a15d25-ef42-48a3-9ac5-94930bfda466 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.097896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 934/1865] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:42 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:43.102570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafabc70-dc7c-4582-82dd-dfc3281690ad admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.107442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a15d25-ef42-48a3-9ac5-94930bfda466 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.160384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:43.213001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a699-4f89-4f99-88a3-e28f83b95df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.213772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a699-4f89-4f99-88a3-e28f83b95df2 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.214123 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a699-4f89-4f99-88a3-e28f83b95df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.214414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1a699-4f89-4f99-88a3-e28f83b95df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.215511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1a699-4f89-4f99-88a3-e28f83b95df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.217618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1a699-4f89-4f99-88a3-e28f83b95df2 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.229429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafabc70-dc7c-4582-82dd-dfc3281690ad admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.242480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4549d-d976-4226-8fce-44bd0c755163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.243255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4549d-d976-4226-8fce-44bd0c755163 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.243637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4549d-d976-4226-8fce-44bd0c755163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.243878 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4549d-d976-4226-8fce-44bd0c755163 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.244618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4549d-d976-4226-8fce-44bd0c755163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.247261 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4549d-d976-4226-8fce-44bd0c755163 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.259708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 932/1866] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:43 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:43.283610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a699-4f89-4f99-88a3-e28f83b95df2 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.321794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 935/1867] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:43 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:43.330813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4549d-d976-4226-8fce-44bd0c755163 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.367744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4549d-d976-4226-8fce-44bd0c755163 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.379567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:43.459382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1a699-4f89-4f99-88a3-e28f83b95df2 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.467187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6b24a-a217-4683-927e-2e311f89b60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.467892 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6b24a-a217-4683-927e-2e311f89b60a admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.468210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6b24a-a217-4683-927e-2e311f89b60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.468492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6b24a-a217-4683-927e-2e311f89b60a admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.469206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6b24a-a217-4683-927e-2e311f89b60a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.471402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6b24a-a217-4683-927e-2e311f89b60a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.501463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 933/1868] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:43 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:43.506571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6b24a-a217-4683-927e-2e311f89b60a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.519098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6b24a-a217-4683-927e-2e311f89b60a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.524472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023f16a-0cc5-41ca-9321-c570ad1e6493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.524850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f16a-0cc5-41ca-9321-c570ad1e6493 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.525434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f16a-0cc5-41ca-9321-c570ad1e6493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.525789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023f16a-0cc5-41ca-9321-c570ad1e6493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.526646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023f16a-0cc5-41ca-9321-c570ad1e6493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.528593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023f16a-0cc5-41ca-9321-c570ad1e6493 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.528917 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d78f17-36d1-40ec-9787-374c2e698006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.529841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d78f17-36d1-40ec-9787-374c2e698006 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.530130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d78f17-36d1-40ec-9787-374c2e698006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.530480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d78f17-36d1-40ec-9787-374c2e698006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.531216 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d78f17-36d1-40ec-9787-374c2e698006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.535366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d78f17-36d1-40ec-9787-374c2e698006 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.552445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 934/1869] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:43.553443 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 936/1870] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:43.556893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023f16a-0cc5-41ca-9321-c570ad1e6493 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.557065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d78f17-36d1-40ec-9787-374c2e698006 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.568696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d78f17-36d1-40ec-9787-374c2e698006 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.591277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8151f-ebe2-4e3a-b623-5d9f4b212876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.592125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8151f-ebe2-4e3a-b623-5d9f4b212876 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.592930 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023f16a-0cc5-41ca-9321-c570ad1e6493 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.593558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8151f-ebe2-4e3a-b623-5d9f4b212876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.594451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8151f-ebe2-4e3a-b623-5d9f4b212876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.595297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8151f-ebe2-4e3a-b623-5d9f4b212876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.598453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8151f-ebe2-4e3a-b623-5d9f4b212876 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.607723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93533c-3a73-435f-b151-e81cec122912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.609397 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93533c-3a73-435f-b151-e81cec122912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.610425 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93533c-3a73-435f-b151-e81cec122912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.610717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93533c-3a73-435f-b151-e81cec122912 admin admin] PATH_INFO: `/v3/projects/dbb1d680c58c4356a29c1524f4d22a53/users/43b945e962834d4c935828f39ae9d727/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.613524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 937/1871] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:43.617819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8151f-ebe2-4e3a-b623-5d9f4b212876 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.632018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8151f-ebe2-4e3a-b623-5d9f4b212876 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.633421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93533c-3a73-435f-b151-e81cec122912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb1d680c58c4356a29c1524f4d22a53, user_id=43b945e962834d4c935828f39ae9d727, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.638687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93533c-3a73-435f-b151-e81cec122912 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.639572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74599e9e-cdba-49f2-9e34-c4dc373fd5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.641048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599e9e-cdba-49f2-9e34-c4dc373fd5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.641835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599e9e-cdba-49f2-9e34-c4dc373fd5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.642322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599e9e-cdba-49f2-9e34-c4dc373fd5eb admin admin] PATH_INFO: `/v3/projects/5a29c74c16c544e0b25c75731a03c215/users/90e24a74e5074b428999b12cade61baf/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.657624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 935/1872] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:43 2022] PUT /identity/v3/projects/dbb1d680c58c4356a29c1524f4d22a53/users/43b945e962834d4c935828f39ae9d727/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:43.662536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93533c-3a73-435f-b151-e81cec122912 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.664005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74599e9e-cdba-49f2-9e34-c4dc373fd5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a29c74c16c544e0b25c75731a03c215, user_id=90e24a74e5074b428999b12cade61baf, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.667388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74599e9e-cdba-49f2-9e34-c4dc373fd5eb admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.702526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 938/1873] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:43 2022] PUT /identity/v3/projects/5a29c74c16c544e0b25c75731a03c215/users/90e24a74e5074b428999b12cade61baf/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:43.704593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd81da-5d7e-4f76-8914-50c93269e4ef None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.705007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd81da-5d7e-4f76-8914-50c93269e4ef None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.705382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd81da-5d7e-4f76-8914-50c93269e4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.755616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-88fd81da-5d7e-4f76-8914-50c93269e4ef None None] MFA Rules not processed for user `90e24a74e5074b428999b12cade61baf`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:43.757009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-88fd81da-5d7e-4f76-8914-50c93269e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:43.773117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93533c-3a73-435f-b151-e81cec122912 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.854476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f40ee-7e61-4f4b-ae91-66d996b5ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.855167 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f40ee-7e61-4f4b-ae91-66d996b5ba8d admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.855456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f40ee-7e61-4f4b-ae91-66d996b5ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.855737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f40ee-7e61-4f4b-ae91-66d996b5ba8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.856643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f40ee-7e61-4f4b-ae91-66d996b5ba8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.858362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f40ee-7e61-4f4b-ae91-66d996b5ba8d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.860474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 939/1874] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:43.864993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd81da-5d7e-4f76-8914-50c93269e4ef None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.879324 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd81da-5d7e-4f76-8914-50c93269e4ef None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.879536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 936/1875] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:43.880533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f40ee-7e61-4f4b-ae91-66d996b5ba8d admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.884996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69dc6b-9d34-435b-9165-df3053c6a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.886878 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69dc6b-9d34-435b-9165-df3053c6a3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.887317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69dc6b-9d34-435b-9165-df3053c6a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.888330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69dc6b-9d34-435b-9165-df3053c6a3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.889213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69dc6b-9d34-435b-9165-df3053c6a3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.891853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69dc6b-9d34-435b-9165-df3053c6a3e2 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.892819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f40ee-7e61-4f4b-ae91-66d996b5ba8d admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:43.896660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:43.898509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e509c-0a0d-443f-9d2b-e4ed03bc51d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:43.900078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e509c-0a0d-443f-9d2b-e4ed03bc51d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.900078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e509c-0a0d-443f-9d2b-e4ed03bc51d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.900527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e509c-0a0d-443f-9d2b-e4ed03bc51d6 admin admin] PATH_INFO: `/v3/projects/dbb1d680c58c4356a29c1524f4d22a53/users/43b945e962834d4c935828f39ae9d727/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.903873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e509c-0a0d-443f-9d2b-e4ed03bc51d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb1d680c58c4356a29c1524f4d22a53, user_id=43b945e962834d4c935828f39ae9d727, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:43.909005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e509c-0a0d-443f-9d2b-e4ed03bc51d6 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:43.936465 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 937/1877] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:43 2022] PUT /identity/v3/projects/dbb1d680c58c4356a29c1524f4d22a53/users/43b945e962834d4c935828f39ae9d727/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:43.936784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 940/1877] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:43 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:43.937765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69dc6b-9d34-435b-9165-df3053c6a3e2 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:43.940421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5417c3-656c-4c9e-8b37-7bcbd050bc6d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:43.941772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5417c3-656c-4c9e-8b37-7bcbd050bc6d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:43.946394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5417c3-656c-4c9e-8b37-7bcbd050bc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:43.993163 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:44.022241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-9b5417c3-656c-4c9e-8b37-7bcbd050bc6d None None] MFA Rules not processed for user `43b945e962834d4c935828f39ae9d727`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:44.024204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9b5417c3-656c-4c9e-8b37-7bcbd050bc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:44.041715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69dc6b-9d34-435b-9165-df3053c6a3e2 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:44.049237 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2de765-2bac-4e4e-8205-b37442643efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:44.058262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2de765-2bac-4e4e-8205-b37442643efa admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:44.058902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2de765-2bac-4e4e-8205-b37442643efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:44.060594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2de765-2bac-4e4e-8205-b37442643efa admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:44.062366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2de765-2bac-4e4e-8205-b37442643efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:44.066561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2de765-2bac-4e4e-8205-b37442643efa admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:44.113631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 941/1878] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:43 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:44.119006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2de765-2bac-4e4e-8205-b37442643efa admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:44.141914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2de765-2bac-4e4e-8205-b37442643efa admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:44.147914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 938/1879] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:44.159877 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db376-6bb0-437e-9ecb-c18e0a0a78db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:44.160144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5417c3-656c-4c9e-8b37-7bcbd050bc6d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:44.160896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db376-6bb0-437e-9ecb-c18e0a0a78db admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:44.162723 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db376-6bb0-437e-9ecb-c18e0a0a78db admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:44.162723 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db376-6bb0-437e-9ecb-c18e0a0a78db admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:44.162937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9b5417c3-656c-4c9e-8b37-7bcbd050bc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:44.163140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2db376-6bb0-437e-9ecb-c18e0a0a78db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:44.164956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2db376-6bb0-437e-9ecb-c18e0a0a78db admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:44.184609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 942/1880] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:44.189323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db376-6bb0-437e-9ecb-c18e0a0a78db admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:44.208697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db376-6bb0-437e-9ecb-c18e0a0a78db admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:44.216676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19fe0-6650-499a-8250-72cdc917ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:44.217711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19fe0-6650-499a-8250-72cdc917ae97 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:44.218569 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19fe0-6650-499a-8250-72cdc917ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:44.219053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19fe0-6650-499a-8250-72cdc917ae97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:44.220342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda19fe0-6650-499a-8250-72cdc917ae97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:44.222185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda19fe0-6650-499a-8250-72cdc917ae97 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:44.254918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 943/1881] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:44.254918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19fe0-6650-499a-8250-72cdc917ae97 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:44.276534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19fe0-6650-499a-8250-72cdc917ae97 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:44.306629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d95aa3-7c5b-4715-b281-84c878f5abdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:44.307990 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95aa3-7c5b-4715-b281-84c878f5abdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:44.311052 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95aa3-7c5b-4715-b281-84c878f5abdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:44.311172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d95aa3-7c5b-4715-b281-84c878f5abdd admin admin] PATH_INFO: `/v3/projects/209427f3ff304d28aa2960c75472d1da/users/e5af5f3a95664a2a9f61882270e1feca/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:44.324880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5417c3-656c-4c9e-8b37-7bcbd050bc6d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:44.334948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17aa178-98fc-432d-bca0-ae259e764417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:44.335555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aa178-98fc-432d-bca0-ae259e764417 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:44.335836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aa178-98fc-432d-bca0-ae259e764417 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:44.336180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aa178-98fc-432d-bca0-ae259e764417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:44.349913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d95aa3-7c5b-4715-b281-84c878f5abdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=209427f3ff304d28aa2960c75472d1da, user_id=e5af5f3a95664a2a9f61882270e1feca, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:44.349913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d95aa3-7c5b-4715-b281-84c878f5abdd admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:44.378063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 944/1882] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:44 2022] PUT /identity/v3/projects/209427f3ff304d28aa2960c75472d1da/users/e5af5f3a95664a2a9f61882270e1feca/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:44.391898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e894-af41-49f5-86ba-484bedf6bca1 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:44.392145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e894-af41-49f5-86ba-484bedf6bca1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:44.392410 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e894-af41-49f5-86ba-484bedf6bca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:44.442080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17aa178-98fc-432d-bca0-ae259e764417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:44.444309 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17aa178-98fc-432d-bca0-ae259e764417 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:44.466980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-86f6e894-af41-49f5-86ba-484bedf6bca1 None None] MFA Rules not processed for user `e5af5f3a95664a2a9f61882270e1feca`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:44.468388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-86f6e894-af41-49f5-86ba-484bedf6bca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:44.474093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 939/1883] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:25:44.610611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 945/1884] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:44.611814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17aa178-98fc-432d-bca0-ae259e764417 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:44.633553 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17aa178-98fc-432d-bca0-ae259e764417 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:44.729401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:44.752090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115b595-b87d-47c1-b172-45992ead51f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:44.753477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115b595-b87d-47c1-b172-45992ead51f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:44.756079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115b595-b87d-47c1-b172-45992ead51f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:44.756687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115b595-b87d-47c1-b172-45992ead51f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:44.757711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115b595-b87d-47c1-b172-45992ead51f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:44.760021 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115b595-b87d-47c1-b172-45992ead51f1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:44.816427 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 940/1885] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:44 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:44.826334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6e894-af41-49f5-86ba-484bedf6bca1 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:44.841956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6e894-af41-49f5-86ba-484bedf6bca1 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:44.863193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:44.930998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebc88b-f306-4bca-8839-379ab30fa78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:44.931763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebc88b-f306-4bca-8839-379ab30fa78e admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:44.932232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebc88b-f306-4bca-8839-379ab30fa78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:44.933162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebc88b-f306-4bca-8839-379ab30fa78e admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:44.933986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebc88b-f306-4bca-8839-379ab30fa78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:44.936027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebc88b-f306-4bca-8839-379ab30fa78e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:44.971294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 946/1886] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:44 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:44.975269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115b595-b87d-47c1-b172-45992ead51f1 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:45.001898 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115b595-b87d-47c1-b172-45992ead51f1 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:45.007174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b7013-4c8b-4a25-9392-598d67410728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:45.007882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b7013-4c8b-4a25-9392-598d67410728 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:45.008200 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b7013-4c8b-4a25-9392-598d67410728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:45.008486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b7013-4c8b-4a25-9392-598d67410728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:45.009476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b7013-4c8b-4a25-9392-598d67410728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:45.011651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b7013-4c8b-4a25-9392-598d67410728 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:45.037249 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 941/1887] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:45.042117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebc88b-f306-4bca-8839-379ab30fa78e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:45.053280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebc88b-f306-4bca-8839-379ab30fa78e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:45.058439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda8ac-64b1-46c5-91f2-dcceac68f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:45.059418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda8ac-64b1-46c5-91f2-dcceac68f442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:45.059771 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda8ac-64b1-46c5-91f2-dcceac68f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:45.060086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda8ac-64b1-46c5-91f2-dcceac68f442 admin admin] PATH_INFO: `/v3/projects/0669565caaaf4f6c83ff50bf69aebe03/users/6da45054d25f4e9db5527ae37e8ff9ba/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:45.075667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eda8ac-64b1-46c5-91f2-dcceac68f442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0669565caaaf4f6c83ff50bf69aebe03, user_id=6da45054d25f4e9db5527ae37e8ff9ba, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:45.078357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eda8ac-64b1-46c5-91f2-dcceac68f442 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:45.093809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 947/1888] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:45 2022] PUT /identity/v3/projects/0669565caaaf4f6c83ff50bf69aebe03/users/6da45054d25f4e9db5527ae37e8ff9ba/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:45.098454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b7013-4c8b-4a25-9392-598d67410728 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:45.111631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b7013-4c8b-4a25-9392-598d67410728 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:45.219269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada962c-2047-480a-ba12-04370c036244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:45.220508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada962c-2047-480a-ba12-04370c036244 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:45.220967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada962c-2047-480a-ba12-04370c036244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:45.221300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada962c-2047-480a-ba12-04370c036244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:45.222702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada962c-2047-480a-ba12-04370c036244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:45.225396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada962c-2047-480a-ba12-04370c036244 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:45.253628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda8ac-64b1-46c5-91f2-dcceac68f442 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:45.263856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 942/1889] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:45.269048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda8ac-64b1-46c5-91f2-dcceac68f442 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:45.280004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320132fd-3166-44ae-8a36-88047424dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:45.282312 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320132fd-3166-44ae-8a36-88047424dd76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:45.282819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320132fd-3166-44ae-8a36-88047424dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:45.283071 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320132fd-3166-44ae-8a36-88047424dd76 admin admin] PATH_INFO: `/v3/projects/0669565caaaf4f6c83ff50bf69aebe03/users/6da45054d25f4e9db5527ae37e8ff9ba/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:45.286158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320132fd-3166-44ae-8a36-88047424dd76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0669565caaaf4f6c83ff50bf69aebe03, user_id=6da45054d25f4e9db5527ae37e8ff9ba, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:45.293807 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320132fd-3166-44ae-8a36-88047424dd76 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:45.312203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 948/1890] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:45 2022] PUT /identity/v3/projects/0669565caaaf4f6c83ff50bf69aebe03/users/6da45054d25f4e9db5527ae37e8ff9ba/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:45.323904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f9a0e-fb48-499f-b0fd-bb1f72de459d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:45.324364 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f9a0e-fb48-499f-b0fd-bb1f72de459d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:45.324891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f9a0e-fb48-499f-b0fd-bb1f72de459d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:45.361399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-f64f9a0e-fb48-499f-b0fd-bb1f72de459d None None] MFA Rules not processed for user `6da45054d25f4e9db5527ae37e8ff9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:45.361772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f64f9a0e-fb48-499f-b0fd-bb1f72de459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:45.482890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 943/1891] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:45.494657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320132fd-3166-44ae-8a36-88047424dd76 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:45.602784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320132fd-3166-44ae-8a36-88047424dd76 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:45.607332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81850df2-3745-4400-99ae-258947860d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:45.608036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850df2-3745-4400-99ae-258947860d84 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:45.608333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850df2-3745-4400-99ae-258947860d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:45.608618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850df2-3745-4400-99ae-258947860d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:45.618823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81850df2-3745-4400-99ae-258947860d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:45.620362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81850df2-3745-4400-99ae-258947860d84 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:45.632020 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 949/1892] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:45.690378 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f9a0e-fb48-499f-b0fd-bb1f72de459d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:45.701608 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f9a0e-fb48-499f-b0fd-bb1f72de459d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:45.705664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aa806-6a95-4565-8a61-afb2850b9c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:45.706247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa806-6a95-4565-8a61-afb2850b9c44 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:45.706582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa806-6a95-4565-8a61-afb2850b9c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:45.706867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa806-6a95-4565-8a61-afb2850b9c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:45.778960 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:45.795794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08aa806-6a95-4565-8a61-afb2850b9c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:45.797335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08aa806-6a95-4565-8a61-afb2850b9c44 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:45.807418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 944/1893] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:46.062009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81850df2-3745-4400-99ae-258947860d84 service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:46.071822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81850df2-3745-4400-99ae-258947860d84 service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:46.078159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5e0d1-7372-477c-9529-d95a785d94ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:46.080728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5e0d1-7372-477c-9529-d95a785d94ac service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:46.080728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5e0d1-7372-477c-9529-d95a785d94ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:46.080728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5e0d1-7372-477c-9529-d95a785d94ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:46.172766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5e0d1-7372-477c-9529-d95a785d94ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:46.174368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5e0d1-7372-477c-9529-d95a785d94ac service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:46.188569 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 950/1894] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:47.020380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aa806-6a95-4565-8a61-afb2850b9c44 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:47.022868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a08aa806-6a95-4565-8a61-afb2850b9c44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:47.107935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aa806-6a95-4565-8a61-afb2850b9c44 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:47.114325 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:47.116483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:47.116483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:47.116483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] PATH_INFO: `/v3/users/1e60fd6140a04286bf365379872856aa` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:47.118083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e60fd6140a04286bf365379872856aa)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:47.121106 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:47.171733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e60fd6140a04286bf365379872856aa'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:47.184761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e60fd6140a04286bf365379872856aa'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:47.185483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e60fd6140a04286bf365379872856aa'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:47.193206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e60fd6140a04286bf365379872856aa'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:47.202490 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e60fd6140a04286bf365379872856aa'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:47.214533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 945/1895] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:47 2022] DELETE /identity/v3/users/1e60fd6140a04286bf365379872856aa => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:47.219331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70374ca-ccd2-4972-994d-45cd0b816fc6 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:47.219809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70374ca-ccd2-4972-994d-45cd0b816fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:47.220189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70374ca-ccd2-4972-994d-45cd0b816fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:47.269026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e70374ca-ccd2-4972-994d-45cd0b816fc6 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:47.270550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e70374ca-ccd2-4972-994d-45cd0b816fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:47.281370 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:47.380912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 951/1896] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:47.389541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:47.390985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:47.508840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed087098-4d3c-4f54-ad80-5dc3e24e87e6 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:47.515320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4716798-2d34-404f-9440-53bf58ef9984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:47.517069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4716798-2d34-404f-9440-53bf58ef9984 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:47.521331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4716798-2d34-404f-9440-53bf58ef9984 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:47.522305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4716798-2d34-404f-9440-53bf58ef9984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:47.543617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4716798-2d34-404f-9440-53bf58ef9984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:47.545808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4716798-2d34-404f-9440-53bf58ef9984 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:47.562300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 946/1897] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:47.930582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70374ca-ccd2-4972-994d-45cd0b816fc6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:47.932039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e70374ca-ccd2-4972-994d-45cd0b816fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:47.948494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70374ca-ccd2-4972-994d-45cd0b816fc6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:47.953737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:47.954619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:47.954900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:47.955177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] PATH_INFO: `/v3/projects/f598ca1bb43d452fbe51ac5e0520c0de` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:47.956406 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f598ca1bb43d452fbe51ac5e0520c0de)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:47.959079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:48.052191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f598ca1bb43d452fbe51ac5e0520c0de', 'request_id': 'req-c7c00b4c-77c3-43b8-8dfc-260092771d23'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.072266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f598ca1bb43d452fbe51ac5e0520c0de', 'request_id': 'req-c7c00b4c-77c3-43b8-8dfc-260092771d23'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.079907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f598ca1bb43d452fbe51ac5e0520c0de', 'request_id': 'req-c7c00b4c-77c3-43b8-8dfc-260092771d23'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.093671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] The token cache is being invalidate because project f598ca1bb43d452fbe51ac5e0520c0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:48.094027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.094729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.096308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 952/1898] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:47 2022] DELETE /identity/v3/projects/f598ca1bb43d452fbe51ac5e0520c0de => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:48.101228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4716798-2d34-404f-9440-53bf58ef9984 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:48.107770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:48.111562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4716798-2d34-404f-9440-53bf58ef9984 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:48.170101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fe295-c0dd-4fa3-a0e4-fa058a50841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:48.170973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fe295-c0dd-4fa3-a0e4-fa058a50841d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:48.171257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fe295-c0dd-4fa3-a0e4-fa058a50841d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:48.171533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fe295-c0dd-4fa3-a0e4-fa058a50841d admin admin] PATH_INFO: `/v3/users/d0ef8c4df74049b2aedc627b2397e1fe` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:48.172746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fe295-c0dd-4fa3-a0e4-fa058a50841d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ef8c4df74049b2aedc627b2397e1fe)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:48.174645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fe295-c0dd-4fa3-a0e4-fa058a50841d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:48.222043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-378fe295-c0dd-4fa3-a0e4-fa058a50841d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ef8c4df74049b2aedc627b2397e1fe'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.239476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-378fe295-c0dd-4fa3-a0e4-fa058a50841d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ef8c4df74049b2aedc627b2397e1fe'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.243190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-378fe295-c0dd-4fa3-a0e4-fa058a50841d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ef8c4df74049b2aedc627b2397e1fe'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.256489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-378fe295-c0dd-4fa3-a0e4-fa058a50841d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ef8c4df74049b2aedc627b2397e1fe'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.266106 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-378fe295-c0dd-4fa3-a0e4-fa058a50841d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ef8c4df74049b2aedc627b2397e1fe'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.273185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 947/1899] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:48 2022] DELETE /identity/v3/users/d0ef8c4df74049b2aedc627b2397e1fe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:48.657918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:48.657918 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:48.671880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c00b4c-77c3-43b8-8dfc-260092771d23 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:48.738145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:48.739100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:48.740228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:48.740705 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] PATH_INFO: `/v3/projects/7ed972956c2f43f3b48dd1c50508faf3` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:48.742753 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed972956c2f43f3b48dd1c50508faf3)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:48.745341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:48.794828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:48.817941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed972956c2f43f3b48dd1c50508faf3', 'request_id': 'req-2a81705d-47e9-4845-a6da-180cc588fea5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.827273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed972956c2f43f3b48dd1c50508faf3', 'request_id': 'req-2a81705d-47e9-4845-a6da-180cc588fea5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.837095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed972956c2f43f3b48dd1c50508faf3', 'request_id': 'req-2a81705d-47e9-4845-a6da-180cc588fea5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.851524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] The token cache is being invalidate because project 7ed972956c2f43f3b48dd1c50508faf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:48.851801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.852870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2a81705d-47e9-4845-a6da-180cc588fea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:48.857419 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 953/1900] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:48 2022] DELETE /identity/v3/projects/7ed972956c2f43f3b48dd1c50508faf3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:48.863440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa10c8-5008-4835-b21b-d3bd8d4ab93f None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:48.863893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa10c8-5008-4835-b21b-d3bd8d4ab93f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:48.864320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa10c8-5008-4835-b21b-d3bd8d4ab93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:48.888822 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-42aa10c8-5008-4835-b21b-d3bd8d4ab93f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:48.890070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-42aa10c8-5008-4835-b21b-d3bd8d4ab93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:48.971256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 948/1901] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:48.987038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7b46f-8b35-40a1-9891-dc37bc32b5ae None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:48.987038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7b46f-8b35-40a1-9891-dc37bc32b5ae None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:48.987038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7b46f-8b35-40a1-9891-dc37bc32b5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.002684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-1dd7b46f-8b35-40a1-9891-dc37bc32b5ae None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:49.003904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1dd7b46f-8b35-40a1-9891-dc37bc32b5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:49.017241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 954/1902] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:49.027095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa10c8-5008-4835-b21b-d3bd8d4ab93f None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:49.040611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa10c8-5008-4835-b21b-d3bd8d4ab93f None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:49.045263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1dbc4-1d96-4af2-bea1-88de9e76e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:49.045966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1dbc4-1d96-4af2-bea1-88de9e76e072 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.046279 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1dbc4-1d96-4af2-bea1-88de9e76e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.046560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1dbc4-1d96-4af2-bea1-88de9e76e072 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.047284 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1dbc4-1d96-4af2-bea1-88de9e76e072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:49.047867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1dbc4-1d96-4af2-bea1-88de9e76e072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:49.049507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1dbc4-1d96-4af2-bea1-88de9e76e072 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:49.066979 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 949/1903] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:49.073318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7b46f-8b35-40a1-9891-dc37bc32b5ae None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:49.083605 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7b46f-8b35-40a1-9891-dc37bc32b5ae None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:49.088973 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2f3df-f98b-47da-a692-70b2ba6ebfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:49.089656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2f3df-f98b-47da-a692-70b2ba6ebfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.089943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2f3df-f98b-47da-a692-70b2ba6ebfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.090292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2f3df-f98b-47da-a692-70b2ba6ebfd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.091015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2f3df-f98b-47da-a692-70b2ba6ebfd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:49.093401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2f3df-f98b-47da-a692-70b2ba6ebfd6 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:49.138902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 955/1904] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:49 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:49.140205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1dbc4-1d96-4af2-bea1-88de9e76e072 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:49.153674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1dbc4-1d96-4af2-bea1-88de9e76e072 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:49.164681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:49.227555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2f3df-f98b-47da-a692-70b2ba6ebfd6 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:49.230473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-89c2f3df-f98b-47da-a692-70b2ba6ebfd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:49.294377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeab3bf-20ab-4866-85a2-97d47303fde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:49.295094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeab3bf-20ab-4866-85a2-97d47303fde8 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.295390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeab3bf-20ab-4866-85a2-97d47303fde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.296591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeab3bf-20ab-4866-85a2-97d47303fde8 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.297339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeab3bf-20ab-4866-85a2-97d47303fde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:49.299993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeab3bf-20ab-4866-85a2-97d47303fde8 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:49.324323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2f3df-f98b-47da-a692-70b2ba6ebfd6 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:49.331464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915bf03-ab41-4c65-beee-9ff3304f3bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:49.332892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915bf03-ab41-4c65-beee-9ff3304f3bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.333324 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915bf03-ab41-4c65-beee-9ff3304f3bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.333758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915bf03-ab41-4c65-beee-9ff3304f3bd2 admin admin] PATH_INFO: `/v3/users/90e24a74e5074b428999b12cade61baf` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.335270 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915bf03-ab41-4c65-beee-9ff3304f3bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e24a74e5074b428999b12cade61baf)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:49.335770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 950/1905] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:49 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:49.337784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915bf03-ab41-4c65-beee-9ff3304f3bd2 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:49.341278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeab3bf-20ab-4866-85a2-97d47303fde8 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:49.354004 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeab3bf-20ab-4866-85a2-97d47303fde8 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:49.360265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed8dbc-91a8-40dd-9d82-0ae82d83102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:49.361224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed8dbc-91a8-40dd-9d82-0ae82d83102e admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.361344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed8dbc-91a8-40dd-9d82-0ae82d83102e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.361681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed8dbc-91a8-40dd-9d82-0ae82d83102e admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.362386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed8dbc-91a8-40dd-9d82-0ae82d83102e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:49.365145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed8dbc-91a8-40dd-9d82-0ae82d83102e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:49.392218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 951/1906] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:49.392384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed8dbc-91a8-40dd-9d82-0ae82d83102e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:49.405190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed8dbc-91a8-40dd-9d82-0ae82d83102e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:49.406339 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b915bf03-ab41-4c65-beee-9ff3304f3bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e24a74e5074b428999b12cade61baf'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:49.407062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b915bf03-ab41-4c65-beee-9ff3304f3bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e24a74e5074b428999b12cade61baf'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:49.410278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007379d-c884-4b47-af36-ed980f9bc8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:49.410951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007379d-c884-4b47-af36-ed980f9bc8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.411233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007379d-c884-4b47-af36-ed980f9bc8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.411543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007379d-c884-4b47-af36-ed980f9bc8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.412305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007379d-c884-4b47-af36-ed980f9bc8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:49.414072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007379d-c884-4b47-af36-ed980f9bc8f9 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:49.423727 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b915bf03-ab41-4c65-beee-9ff3304f3bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e24a74e5074b428999b12cade61baf'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:49.424969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b915bf03-ab41-4c65-beee-9ff3304f3bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e24a74e5074b428999b12cade61baf'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:49.436519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 952/1907] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:49.438451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b915bf03-ab41-4c65-beee-9ff3304f3bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e24a74e5074b428999b12cade61baf'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:49.440942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007379d-c884-4b47-af36-ed980f9bc8f9 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:49.444434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0007379d-c884-4b47-af36-ed980f9bc8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:49.461480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 956/1908] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:49 2022] DELETE /identity/v3/users/90e24a74e5074b428999b12cade61baf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:49.463024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634dd70-a8b1-49c4-b5c1-6f61dd206734 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.464450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634dd70-a8b1-49c4-b5c1-6f61dd206734 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.464450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634dd70-a8b1-49c4-b5c1-6f61dd206734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.472946 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007379d-c884-4b47-af36-ed980f9bc8f9 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:49.502579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4634dd70-a8b1-49c4-b5c1-6f61dd206734 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:49.504006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4634dd70-a8b1-49c4-b5c1-6f61dd206734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:49.514359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:49.569810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31252e-fd70-43a7-8a4c-5e530bb23a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:49.570743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31252e-fd70-43a7-8a4c-5e530bb23a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.571163 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31252e-fd70-43a7-8a4c-5e530bb23a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.571467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31252e-fd70-43a7-8a4c-5e530bb23a07 admin admin] PATH_INFO: `/v3/projects/8bd79247108146108aa90144f49ba1e0/users/2cb78e93539c4799add7c12014009d2e/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.589769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31252e-fd70-43a7-8a4c-5e530bb23a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd79247108146108aa90144f49ba1e0, user_id=2cb78e93539c4799add7c12014009d2e, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:49.594577 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31252e-fd70-43a7-8a4c-5e530bb23a07 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:49.596651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 957/1909] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:49.603483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634dd70-a8b1-49c4-b5c1-6f61dd206734 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:49.605505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4634dd70-a8b1-49c4-b5c1-6f61dd206734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:49.616064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 953/1910] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:49 2022] PUT /identity/v3/projects/8bd79247108146108aa90144f49ba1e0/users/2cb78e93539c4799add7c12014009d2e/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:49.626831 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d0f4f-6a8a-4385-8606-4a483d17f08e None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.627394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d0f4f-6a8a-4385-8606-4a483d17f08e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.627865 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d0f4f-6a8a-4385-8606-4a483d17f08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.661389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e52d0f4f-6a8a-4385-8606-4a483d17f08e None None] MFA Rules not processed for user `2cb78e93539c4799add7c12014009d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:49.663446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e52d0f4f-6a8a-4385-8606-4a483d17f08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:49.674710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634dd70-a8b1-49c4-b5c1-6f61dd206734 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:49.734377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8503ca1-5eab-4dc3-a5e6-7d673adb4a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:49.735142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503ca1-5eab-4dc3-a5e6-7d673adb4a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.735491 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503ca1-5eab-4dc3-a5e6-7d673adb4a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.735838 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503ca1-5eab-4dc3-a5e6-7d673adb4a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.792974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:49.820398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 954/1911] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:49.825737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d0f4f-6a8a-4385-8606-4a483d17f08e None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:49.829642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8503ca1-5eab-4dc3-a5e6-7d673adb4a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:49.830949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8503ca1-5eab-4dc3-a5e6-7d673adb4a05 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:49.840251 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d0f4f-6a8a-4385-8606-4a483d17f08e None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:49.843368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 958/1912] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:49.845147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab67a2-242f-4045-907b-7ae7c6697dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:49.845922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab67a2-242f-4045-907b-7ae7c6697dce admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.846307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab67a2-242f-4045-907b-7ae7c6697dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.846682 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab67a2-242f-4045-907b-7ae7c6697dce admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.847506 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab67a2-242f-4045-907b-7ae7c6697dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:49.849560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab67a2-242f-4045-907b-7ae7c6697dce admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:49.891773 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 955/1913] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:49 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:49.895876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8503ca1-5eab-4dc3-a5e6-7d673adb4a05 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:49.906061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8503ca1-5eab-4dc3-a5e6-7d673adb4a05 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:49.927905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:49.983080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d0654-566e-467a-9c28-dd293cd2b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:49.983772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d0654-566e-467a-9c28-dd293cd2b215 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:49.984236 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d0654-566e-467a-9c28-dd293cd2b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:49.984552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d0654-566e-467a-9c28-dd293cd2b215 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:49.985856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d0654-566e-467a-9c28-dd293cd2b215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:49.989081 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d0654-566e-467a-9c28-dd293cd2b215 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:50.030926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 959/1914] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:49 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:50.035033 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab67a2-242f-4045-907b-7ae7c6697dce admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:50.046497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab67a2-242f-4045-907b-7ae7c6697dce admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:50.061168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179d8b-4349-4d99-a57f-b7531767f01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:50.061926 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179d8b-4349-4d99-a57f-b7531767f01c admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:50.062258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179d8b-4349-4d99-a57f-b7531767f01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:50.062546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7179d8b-4349-4d99-a57f-b7531767f01c admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:50.065532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7179d8b-4349-4d99-a57f-b7531767f01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:50.068524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7179d8b-4349-4d99-a57f-b7531767f01c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:50.098669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d0654-566e-467a-9c28-dd293cd2b215 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:50.109498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 956/1915] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:50.112368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d0654-566e-467a-9c28-dd293cd2b215 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:50.124537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9608d-d3ae-45a1-9ade-9cbcb16a9e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:50.125982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9608d-d3ae-45a1-9ade-9cbcb16a9e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:50.126680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9608d-d3ae-45a1-9ade-9cbcb16a9e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:50.126979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9608d-d3ae-45a1-9ade-9cbcb16a9e86 admin admin] PATH_INFO: `/v3/projects/3a62f0a6e9eb48718ce8b43ef2c7ae73/users/ab8d6d23e29d4451bb9c63f1d2e5edb6/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:50.162169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9608d-d3ae-45a1-9ade-9cbcb16a9e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a62f0a6e9eb48718ce8b43ef2c7ae73, user_id=ab8d6d23e29d4451bb9c63f1d2e5edb6, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:50.168378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9608d-d3ae-45a1-9ade-9cbcb16a9e86 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:50.210069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 960/1916] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:50 2022] PUT /identity/v3/projects/3a62f0a6e9eb48718ce8b43ef2c7ae73/users/ab8d6d23e29d4451bb9c63f1d2e5edb6/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:50.212930 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179d8b-4349-4d99-a57f-b7531767f01c admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:50.226707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7179d8b-4349-4d99-a57f-b7531767f01c admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:50.314024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9608d-d3ae-45a1-9ade-9cbcb16a9e86 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:50.316183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d4f9608d-d3ae-45a1-9ade-9cbcb16a9e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:50.320587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb217d-7203-4e74-8d5e-168a0aca528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:50.321299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb217d-7203-4e74-8d5e-168a0aca528c admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:50.321592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb217d-7203-4e74-8d5e-168a0aca528c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:50.321876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb217d-7203-4e74-8d5e-168a0aca528c admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:50.322653 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb217d-7203-4e74-8d5e-168a0aca528c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:50.324342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb217d-7203-4e74-8d5e-168a0aca528c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:50.334853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9608d-d3ae-45a1-9ade-9cbcb16a9e86 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:50.337606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 957/1917] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:50.342372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb217d-7203-4e74-8d5e-168a0aca528c admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:50.344522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:50.345870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:50.346164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:50.346449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] PATH_INFO: `/v3/projects/5a29c74c16c544e0b25c75731a03c215` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:50.347733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a29c74c16c544e0b25c75731a03c215)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:50.350186 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:50.356229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb217d-7203-4e74-8d5e-168a0aca528c admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:50.363474 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3cdda-28ff-4f8a-9048-48b6248d9f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:50.364370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3cdda-28ff-4f8a-9048-48b6248d9f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:50.364836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3cdda-28ff-4f8a-9048-48b6248d9f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:50.365223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3cdda-28ff-4f8a-9048-48b6248d9f45 admin admin] PATH_INFO: `/v3/projects/3a62f0a6e9eb48718ce8b43ef2c7ae73/users/ab8d6d23e29d4451bb9c63f1d2e5edb6/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:50.367629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3cdda-28ff-4f8a-9048-48b6248d9f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a62f0a6e9eb48718ce8b43ef2c7ae73, user_id=ab8d6d23e29d4451bb9c63f1d2e5edb6, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:50.371395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3cdda-28ff-4f8a-9048-48b6248d9f45 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:50.385706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 958/1918] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:50 2022] PUT /identity/v3/projects/3a62f0a6e9eb48718ce8b43ef2c7ae73/users/ab8d6d23e29d4451bb9c63f1d2e5edb6/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:50.396996 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a332-a9c8-4d04-a1a0-65c315ce4bc6 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:50.397294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a332-a9c8-4d04-a1a0-65c315ce4bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:50.397682 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62a332-a9c8-4d04-a1a0-65c315ce4bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:50.410365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a29c74c16c544e0b25c75731a03c215', 'request_id': 'req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.420860 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a29c74c16c544e0b25c75731a03c215', 'request_id': 'req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.427648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a29c74c16c544e0b25c75731a03c215', 'request_id': 'req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.429070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-9b62a332-a9c8-4d04-a1a0-65c315ce4bc6 None None] MFA Rules not processed for user `ab8d6d23e29d4451bb9c63f1d2e5edb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:50.430450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9b62a332-a9c8-4d04-a1a0-65c315ce4bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:50.441724 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] The token cache is being invalidate because project 5a29c74c16c544e0b25c75731a03c215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:50.442011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.442814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.444936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 961/1919] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:50 2022] DELETE /identity/v3/projects/5a29c74c16c544e0b25c75731a03c215 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:50.449446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:50.451516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:50.506799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 959/1920] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:50.518714 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62a332-a9c8-4d04-a1a0-65c315ce4bc6 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:50.520159 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9b62a332-a9c8-4d04-a1a0-65c315ce4bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:50.535916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d42ac-9a97-4abf-a7c9-f78b405c5e5c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:50.542371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:50.543589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:50.544047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:50.544426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] PATH_INFO: `/v3/users/e5af5f3a95664a2a9f61882270e1feca` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:50.545993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5af5f3a95664a2a9f61882270e1feca)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:50.548408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:50.564479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:50.571595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:50.628843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62a332-a9c8-4d04-a1a0-65c315ce4bc6 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:50.637367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58714345-5727-415f-9016-a8cf913d4d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:50.639185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58714345-5727-415f-9016-a8cf913d4d86 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:50.641158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58714345-5727-415f-9016-a8cf913d4d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:50.641510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58714345-5727-415f-9016-a8cf913d4d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:50.648364 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5af5f3a95664a2a9f61882270e1feca'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.649341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5af5f3a95664a2a9f61882270e1feca'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.653280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58714345-5727-415f-9016-a8cf913d4d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:50.654841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58714345-5727-415f-9016-a8cf913d4d86 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:50.663476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5af5f3a95664a2a9f61882270e1feca'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.664328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5af5f3a95664a2a9f61882270e1feca'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.666175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 960/1921] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:25:50.667294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58714345-5727-415f-9016-a8cf913d4d86 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:50.669142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-58714345-5727-415f-9016-a8cf913d4d86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:50.685679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58714345-5727-415f-9016-a8cf913d4d86 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:50.690110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5af5f3a95664a2a9f61882270e1feca'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.694112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d0b14-6080-4f1c-baf8-ebc41c5fac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:50.695330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d0b14-6080-4f1c-baf8-ebc41c5fac53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:50.695737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d0b14-6080-4f1c-baf8-ebc41c5fac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:50.697285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d0b14-6080-4f1c-baf8-ebc41c5fac53 admin admin] PATH_INFO: `/v3/users/aa4ff3f3e1484e16a7aa1ed567432a8b` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:50.699037 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d0b14-6080-4f1c-baf8-ebc41c5fac53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4ff3f3e1484e16a7aa1ed567432a8b)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:50.701664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d0b14-6080-4f1c-baf8-ebc41c5fac53 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:50.716277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 962/1922] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:50 2022] DELETE /identity/v3/users/e5af5f3a95664a2a9f61882270e1feca => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:50.786431 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-eb9d0b14-6080-4f1c-baf8-ebc41c5fac53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4ff3f3e1484e16a7aa1ed567432a8b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.790739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:50.793304 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:50.819575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-eb9d0b14-6080-4f1c-baf8-ebc41c5fac53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4ff3f3e1484e16a7aa1ed567432a8b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.820455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-eb9d0b14-6080-4f1c-baf8-ebc41c5fac53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4ff3f3e1484e16a7aa1ed567432a8b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.830177 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-eb9d0b14-6080-4f1c-baf8-ebc41c5fac53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4ff3f3e1484e16a7aa1ed567432a8b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.842881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-eb9d0b14-6080-4f1c-baf8-ebc41c5fac53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4ff3f3e1484e16a7aa1ed567432a8b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:50.856051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 961/1923] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:50 2022] DELETE /identity/v3/users/aa4ff3f3e1484e16a7aa1ed567432a8b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:50.861120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71429d-bb7b-44a1-b21f-4d9cabd7e60d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:50.861487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71429d-bb7b-44a1-b21f-4d9cabd7e60d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:50.862082 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71429d-bb7b-44a1-b21f-4d9cabd7e60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:50.893146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ee71429d-bb7b-44a1-b21f-4d9cabd7e60d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:50.894540 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ee71429d-bb7b-44a1-b21f-4d9cabd7e60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:50.929375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1e17b-6484-4831-b9a4-ad6461c663a0 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:51.009907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9157-9c5f-4e4e-898d-15038fa2889f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:51.011762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9157-9c5f-4e4e-898d-15038fa2889f service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:51.012157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9157-9c5f-4e4e-898d-15038fa2889f service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:51.012510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9157-9c5f-4e4e-898d-15038fa2889f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:51.015008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b3ea9157-9c5f-4e4e-898d-15038fa2889f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:51.043025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 962/1924] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:51.078017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71429d-bb7b-44a1-b21f-4d9cabd7e60d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:51.079856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ee71429d-bb7b-44a1-b21f-4d9cabd7e60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:51.087592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9157-9c5f-4e4e-898d-15038fa2889f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:51.090061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9157-9c5f-4e4e-898d-15038fa2889f service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:51.095051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:51.103720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 963/1925] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:51.206574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:51.241160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71429d-bb7b-44a1-b21f-4d9cabd7e60d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:51.255096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8615a95-85f9-4881-a9f9-ab6cdad25c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:51.255951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615a95-85f9-4881-a9f9-ab6cdad25c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:51.256375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615a95-85f9-4881-a9f9-ab6cdad25c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:51.257490 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615a95-85f9-4881-a9f9-ab6cdad25c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:51.273342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8615a95-85f9-4881-a9f9-ab6cdad25c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:51.275621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8615a95-85f9-4881-a9f9-ab6cdad25c46 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:51.290236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 963/1926] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:51.348160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9157-9c5f-4e4e-898d-15038fa2889f service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:51.349784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b3ea9157-9c5f-4e4e-898d-15038fa2889f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:51.372531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9157-9c5f-4e4e-898d-15038fa2889f service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:51.377638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:51.378676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:51.379076 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:51.379485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] PATH_INFO: `/v3/projects/209427f3ff304d28aa2960c75472d1da` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:51.382425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=209427f3ff304d28aa2960c75472d1da)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:51.384557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:51.461867 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209427f3ff304d28aa2960c75472d1da', 'request_id': 'req-80749ab9-d58d-4431-a5c7-844807a2d55b'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:51.482993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209427f3ff304d28aa2960c75472d1da', 'request_id': 'req-80749ab9-d58d-4431-a5c7-844807a2d55b'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:51.491909 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209427f3ff304d28aa2960c75472d1da', 'request_id': 'req-80749ab9-d58d-4431-a5c7-844807a2d55b'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:51.524452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] The token cache is being invalidate because project 209427f3ff304d28aa2960c75472d1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:51.525034 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:51.525903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:51.531526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 964/1927] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:51 2022] DELETE /identity/v3/projects/209427f3ff304d28aa2960c75472d1da => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:51.532071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8615a95-85f9-4881-a9f9-ab6cdad25c46 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:51.553217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8615a95-85f9-4881-a9f9-ab6cdad25c46 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:51.667573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:51.669104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:51.670473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:51.670782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] PATH_INFO: `/v3/users/6da45054d25f4e9db5527ae37e8ff9ba` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:51.673219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da45054d25f4e9db5527ae37e8ff9ba)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:51.677277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:51.732858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da45054d25f4e9db5527ae37e8ff9ba'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:51.748009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da45054d25f4e9db5527ae37e8ff9ba'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:51.748904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da45054d25f4e9db5527ae37e8ff9ba'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:51.764367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da45054d25f4e9db5527ae37e8ff9ba'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:51.773680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da45054d25f4e9db5527ae37e8ff9ba'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:51.784223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 964/1928] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:51 2022] DELETE /identity/v3/users/6da45054d25f4e9db5527ae37e8ff9ba => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:52.205266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:52.207214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:52.224067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80749ab9-d58d-4431-a5c7-844807a2d55b admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:52.249246 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:52.253413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:52.304350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:52.305294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:52.305587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:52.305866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] PATH_INFO: `/v3/projects/0669565caaaf4f6c83ff50bf69aebe03` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:52.307459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0669565caaaf4f6c83ff50bf69aebe03)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:52.309906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:52.367060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f25afc-d529-42d8-a695-d6189933bb67 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:52.374986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0669565caaaf4f6c83ff50bf69aebe03', 'request_id': 'req-c3f5b103-4044-4add-b154-692edb2255f7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.380187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:52.384615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0669565caaaf4f6c83ff50bf69aebe03', 'request_id': 'req-c3f5b103-4044-4add-b154-692edb2255f7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.393108 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0669565caaaf4f6c83ff50bf69aebe03', 'request_id': 'req-c3f5b103-4044-4add-b154-692edb2255f7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.405971 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] The token cache is being invalidate because project 0669565caaaf4f6c83ff50bf69aebe03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:52.406536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.407450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c3f5b103-4044-4add-b154-692edb2255f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.409566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 965/1929] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:52 2022] DELETE /identity/v3/projects/0669565caaaf4f6c83ff50bf69aebe03 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:52.417702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1a34f-16aa-4679-83d8-dbd20ba302a1 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:52.418123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1a34f-16aa-4679-83d8-dbd20ba302a1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:52.418502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1a34f-16aa-4679-83d8-dbd20ba302a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:52.442080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-39e1a34f-16aa-4679-83d8-dbd20ba302a1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:52.442259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-39e1a34f-16aa-4679-83d8-dbd20ba302a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:52.454793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:52.456005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:52.456380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:52.456794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] PATH_INFO: `/v3/projects/125f31b094c043a38b9572d62fd7e5dd` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:52.458263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=125f31b094c043a38b9572d62fd7e5dd)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:52.460435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:52.464103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 966/1930] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:52.468161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134d75-0548-4071-8f61-f5bdc9ba4240 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:52.468454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134d75-0548-4071-8f61-f5bdc9ba4240 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:52.468870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134d75-0548-4071-8f61-f5bdc9ba4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:52.477170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:52.490956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ff134d75-0548-4071-8f61-f5bdc9ba4240 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:52.492645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ff134d75-0548-4071-8f61-f5bdc9ba4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:52.502897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 967/1931] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:52.507183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff134d75-0548-4071-8f61-f5bdc9ba4240 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:52.517240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff134d75-0548-4071-8f61-f5bdc9ba4240 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:52.521460 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125f31b094c043a38b9572d62fd7e5dd', 'request_id': 'req-49cead05-7203-4705-b7f4-61ee6ccfcf86'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.531340 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125f31b094c043a38b9572d62fd7e5dd', 'request_id': 'req-49cead05-7203-4705-b7f4-61ee6ccfcf86'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.540184 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125f31b094c043a38b9572d62fd7e5dd', 'request_id': 'req-49cead05-7203-4705-b7f4-61ee6ccfcf86'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.554530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] The token cache is being invalidate because project 125f31b094c043a38b9572d62fd7e5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:52.554957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.555797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.558339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 965/1932] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:52 2022] DELETE /identity/v3/projects/125f31b094c043a38b9572d62fd7e5dd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:52.561956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:52.563581 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:52.582368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea4e89-e122-46ae-a2fb-bc9fcef47926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:52.583556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea4e89-e122-46ae-a2fb-bc9fcef47926 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:52.583810 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea4e89-e122-46ae-a2fb-bc9fcef47926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:52.584137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea4e89-e122-46ae-a2fb-bc9fcef47926 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:52.585432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea4e89-e122-46ae-a2fb-bc9fcef47926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:52.585756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea4e89-e122-46ae-a2fb-bc9fcef47926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:52.587690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea4e89-e122-46ae-a2fb-bc9fcef47926 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:52.606281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 968/1933] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:25:52.607631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea4e89-e122-46ae-a2fb-bc9fcef47926 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:52.609590 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e2ea4e89-e122-46ae-a2fb-bc9fcef47926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:52.623193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea4e89-e122-46ae-a2fb-bc9fcef47926 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:52.628845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc738b5c-fafb-4ef9-aa09-b39fcc4aeafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:52.629615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc738b5c-fafb-4ef9-aa09-b39fcc4aeafe admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:52.630001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc738b5c-fafb-4ef9-aa09-b39fcc4aeafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:52.630381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc738b5c-fafb-4ef9-aa09-b39fcc4aeafe admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:52.631177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc738b5c-fafb-4ef9-aa09-b39fcc4aeafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:52.633677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc738b5c-fafb-4ef9-aa09-b39fcc4aeafe admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:52.638310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cead05-7203-4705-b7f4-61ee6ccfcf86 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:52.644470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:52.645324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:52.645619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:52.645901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] PATH_INFO: `/v3/users/43b945e962834d4c935828f39ae9d727` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:52.647667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b945e962834d4c935828f39ae9d727)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:52.651068 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:52.681894 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 969/1934] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:52 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:52.686480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc738b5c-fafb-4ef9-aa09-b39fcc4aeafe admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:52.756586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:52.762126 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b945e962834d4c935828f39ae9d727'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.788677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc738b5c-fafb-4ef9-aa09-b39fcc4aeafe admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:52.793969 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b945e962834d4c935828f39ae9d727'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.796120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b945e962834d4c935828f39ae9d727'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.799995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c67cb-ee41-4cbd-9613-47aec671debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:52.801515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c67cb-ee41-4cbd-9613-47aec671debb admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:52.801951 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c67cb-ee41-4cbd-9613-47aec671debb admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:52.804240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c67cb-ee41-4cbd-9613-47aec671debb admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:52.806095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c67cb-ee41-4cbd-9613-47aec671debb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:52.810119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c67cb-ee41-4cbd-9613-47aec671debb admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:52.811777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b945e962834d4c935828f39ae9d727'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.821859 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b945e962834d4c935828f39ae9d727'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:52.830937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 966/1935] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:52 2022] DELETE /identity/v3/users/43b945e962834d4c935828f39ae9d727 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:52.881372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 970/1936] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:52 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:25:52.882548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:52.884356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:53.048328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bdeaf-c833-4020-9cbf-d49f78752a25 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:53.058571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce76db0-050d-4626-88b1-552fb339748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:53.059295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce76db0-050d-4626-88b1-552fb339748c admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.059578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce76db0-050d-4626-88b1-552fb339748c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.059928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce76db0-050d-4626-88b1-552fb339748c admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.060607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce76db0-050d-4626-88b1-552fb339748c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:53.063986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce76db0-050d-4626-88b1-552fb339748c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:53.090633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c67cb-ee41-4cbd-9613-47aec671debb admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:53.101230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 967/1937] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:53.104947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c67cb-ee41-4cbd-9613-47aec671debb admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:53.121147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13416af-f688-476c-b875-308543b122f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:53.121313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13416af-f688-476c-b875-308543b122f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.122325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13416af-f688-476c-b875-308543b122f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.122612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13416af-f688-476c-b875-308543b122f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.123355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13416af-f688-476c-b875-308543b122f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:53.124977 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13416af-f688-476c-b875-308543b122f5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:53.147686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 971/1938] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:53.153888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce76db0-050d-4626-88b1-552fb339748c admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:53.169510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce76db0-050d-4626-88b1-552fb339748c admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:53.181191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381598d-e369-4f15-a623-64bed108efea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:53.182106 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381598d-e369-4f15-a623-64bed108efea admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.182391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381598d-e369-4f15-a623-64bed108efea admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.182670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381598d-e369-4f15-a623-64bed108efea admin admin] PATH_INFO: `/v3/projects/23a40867c5c14dd5823c481b03448d9b/users/318b7b1d48cc40b7a2e5ad4f7e13a625/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.237699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381598d-e369-4f15-a623-64bed108efea admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a40867c5c14dd5823c481b03448d9b, user_id=318b7b1d48cc40b7a2e5ad4f7e13a625, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:53.241292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381598d-e369-4f15-a623-64bed108efea admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:53.280785 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 968/1939] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:53 2022] PUT /identity/v3/projects/23a40867c5c14dd5823c481b03448d9b/users/318b7b1d48cc40b7a2e5ad4f7e13a625/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:53.283511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9513ed-6d6f-4cdb-ad58-aeb6f21bc8c6 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.284518 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9513ed-6d6f-4cdb-ad58-aeb6f21bc8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.284946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9513ed-6d6f-4cdb-ad58-aeb6f21bc8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.359903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-7f9513ed-6d6f-4cdb-ad58-aeb6f21bc8c6 None None] MFA Rules not processed for user `318b7b1d48cc40b7a2e5ad4f7e13a625`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:53.364203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7f9513ed-6d6f-4cdb-ad58-aeb6f21bc8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:53.431636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:53.443875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381598d-e369-4f15-a623-64bed108efea admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:53.448032 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3381598d-e369-4f15-a623-64bed108efea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:53.522678 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 972/1940] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:53.536227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9513ed-6d6f-4cdb-ad58-aeb6f21bc8c6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:53.537847 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7f9513ed-6d6f-4cdb-ad58-aeb6f21bc8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:53.567501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381598d-e369-4f15-a623-64bed108efea admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:53.573043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:53.574162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.574700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.574987 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] PATH_INFO: `/v3/projects/dbb1d680c58c4356a29c1524f4d22a53` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.576224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb1d680c58c4356a29c1524f4d22a53)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:53.578130 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:53.606124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9513ed-6d6f-4cdb-ad58-aeb6f21bc8c6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:53.609925 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355a81f-90bd-4acc-9a02-54a47359970e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:53.610931 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355a81f-90bd-4acc-9a02-54a47359970e service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.611232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355a81f-90bd-4acc-9a02-54a47359970e service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.611513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355a81f-90bd-4acc-9a02-54a47359970e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.624273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355a81f-90bd-4acc-9a02-54a47359970e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:53.625988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355a81f-90bd-4acc-9a02-54a47359970e service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:53.628331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:53.637471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 973/1941] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:53.646120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb1d680c58c4356a29c1524f4d22a53', 'request_id': 'req-46f3b0a7-cb2a-4896-ada4-98f098002935'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:53.655405 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb1d680c58c4356a29c1524f4d22a53', 'request_id': 'req-46f3b0a7-cb2a-4896-ada4-98f098002935'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:53.660374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355a81f-90bd-4acc-9a02-54a47359970e service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:53.662593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb1d680c58c4356a29c1524f4d22a53', 'request_id': 'req-46f3b0a7-cb2a-4896-ada4-98f098002935'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:53.671639 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355a81f-90bd-4acc-9a02-54a47359970e service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:53.674430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] The token cache is being invalidate because project dbb1d680c58c4356a29c1524f4d22a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:53.674725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:53.675474 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-46f3b0a7-cb2a-4896-ada4-98f098002935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:53.677055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 969/1942] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:53 2022] DELETE /identity/v3/projects/dbb1d680c58c4356a29c1524f4d22a53 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:53.681661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb16ccf-55e6-4969-86dd-b80a6ab7f191 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.682031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb16ccf-55e6-4969-86dd-b80a6ab7f191 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.682317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb16ccf-55e6-4969-86dd-b80a6ab7f191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.700485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ccb16ccf-55e6-4969-86dd-b80a6ab7f191 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:53.701703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ccb16ccf-55e6-4969-86dd-b80a6ab7f191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:53.731892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd846e6-faa7-4417-aebe-e1232e4bf5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:53.732842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd846e6-faa7-4417-aebe-e1232e4bf5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.733128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd846e6-faa7-4417-aebe-e1232e4bf5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.733420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd846e6-faa7-4417-aebe-e1232e4bf5c3 admin admin] PATH_INFO: `/v3/users/318b7b1d48cc40b7a2e5ad4f7e13a625` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.734756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd846e6-faa7-4417-aebe-e1232e4bf5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=318b7b1d48cc40b7a2e5ad4f7e13a625)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:53.736847 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd846e6-faa7-4417-aebe-e1232e4bf5c3 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:53.768474 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 970/1943] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:53.777044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d068d-685d-4fd3-a0ea-96961da717d9 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.777350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d068d-685d-4fd3-a0ea-96961da717d9 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.777660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d068d-685d-4fd3-a0ea-96961da717d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.797520 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9cd846e6-faa7-4417-aebe-e1232e4bf5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '318b7b1d48cc40b7a2e5ad4f7e13a625'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:53.798380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9cd846e6-faa7-4417-aebe-e1232e4bf5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '318b7b1d48cc40b7a2e5ad4f7e13a625'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:53.799358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-3e2d068d-685d-4fd3-a0ea-96961da717d9 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:53.800795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3e2d068d-685d-4fd3-a0ea-96961da717d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:53.810005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 971/1944] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:53.814133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d068d-685d-4fd3-a0ea-96961da717d9 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:53.814314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9cd846e6-faa7-4417-aebe-e1232e4bf5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '318b7b1d48cc40b7a2e5ad4f7e13a625'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:53.815003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9cd846e6-faa7-4417-aebe-e1232e4bf5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '318b7b1d48cc40b7a2e5ad4f7e13a625'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:53.824057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9cd846e6-faa7-4417-aebe-e1232e4bf5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '318b7b1d48cc40b7a2e5ad4f7e13a625'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:53.825858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d068d-685d-4fd3-a0ea-96961da717d9 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:53.833503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08602185-0273-444c-b803-2b296d04f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:53.834442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08602185-0273-444c-b803-2b296d04f6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.834746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:53.835231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08602185-0273-444c-b803-2b296d04f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.835550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08602185-0273-444c-b803-2b296d04f6d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.836646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08602185-0273-444c-b803-2b296d04f6d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:53.837236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08602185-0273-444c-b803-2b296d04f6d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:53.839726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08602185-0273-444c-b803-2b296d04f6d1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:53.843456 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 974/1945] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:53 2022] DELETE /identity/v3/users/318b7b1d48cc40b7a2e5ad4f7e13a625 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:53.847540 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f771b7-2032-444d-88c8-c56a276cea13 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.848384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f771b7-2032-444d-88c8-c56a276cea13 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.849236 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f771b7-2032-444d-88c8-c56a276cea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.862978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 972/1946] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:25:53.864058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08602185-0273-444c-b803-2b296d04f6d1 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:53.868009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-08602185-0273-444c-b803-2b296d04f6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:53.872318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-19f771b7-2032-444d-88c8-c56a276cea13 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:53.873536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-19f771b7-2032-444d-88c8-c56a276cea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:53.884695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08602185-0273-444c-b803-2b296d04f6d1 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:53.948512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 975/1947] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:53.954481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98377eba-eb60-4047-8657-445c5b9a6465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:53.955334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98377eba-eb60-4047-8657-445c5b9a6465 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:53.955624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98377eba-eb60-4047-8657-445c5b9a6465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:53.955905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98377eba-eb60-4047-8657-445c5b9a6465 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:53.956638 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98377eba-eb60-4047-8657-445c5b9a6465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:53.958962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98377eba-eb60-4047-8657-445c5b9a6465 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:53.961150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f771b7-2032-444d-88c8-c56a276cea13 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:53.963609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-19f771b7-2032-444d-88c8-c56a276cea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:54.063186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 973/1948] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:53 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:54.064270 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98377eba-eb60-4047-8657-445c5b9a6465 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:54.125246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f771b7-2032-444d-88c8-c56a276cea13 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:54.125506 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:54.194726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98377eba-eb60-4047-8657-445c5b9a6465 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:54.203397 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb069cd-f019-495d-b1a5-f8200b6da1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:54.205087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb069cd-f019-495d-b1a5-f8200b6da1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:54.205680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb069cd-f019-495d-b1a5-f8200b6da1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:54.206166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb069cd-f019-495d-b1a5-f8200b6da1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:54.207069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb069cd-f019-495d-b1a5-f8200b6da1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:54.209947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb069cd-f019-495d-b1a5-f8200b6da1f3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:54.250475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 974/1949] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:54 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:54.254286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb069cd-f019-495d-b1a5-f8200b6da1f3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:54.268758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817587a0-81ec-4100-b4d5-7b1b019cc67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:54.270359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817587a0-81ec-4100-b4d5-7b1b019cc67f service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:54.270513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817587a0-81ec-4100-b4d5-7b1b019cc67f service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:54.270644 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb069cd-f019-495d-b1a5-f8200b6da1f3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:54.270816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817587a0-81ec-4100-b4d5-7b1b019cc67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:54.276169 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a2c35-1251-4442-914d-ad969a379b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:54.276872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a2c35-1251-4442-914d-ad969a379b81 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:54.277112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a2c35-1251-4442-914d-ad969a379b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:54.277394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a2c35-1251-4442-914d-ad969a379b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:54.278124 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a2c35-1251-4442-914d-ad969a379b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:54.280352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a2c35-1251-4442-914d-ad969a379b81 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:54.290659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817587a0-81ec-4100-b4d5-7b1b019cc67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:54.292698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817587a0-81ec-4100-b4d5-7b1b019cc67f service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:54.293096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 975/1950] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:54.296726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a2c35-1251-4442-914d-ad969a379b81 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:54.315030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a2c35-1251-4442-914d-ad969a379b81 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:54.329220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 976/1951] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:54.338866 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432b34c-8c69-4aa2-8cd8-77926ea95f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:54.340107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432b34c-8c69-4aa2-8cd8-77926ea95f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:54.340107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432b34c-8c69-4aa2-8cd8-77926ea95f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:54.340300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432b34c-8c69-4aa2-8cd8-77926ea95f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:54.341125 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432b34c-8c69-4aa2-8cd8-77926ea95f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:54.343577 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432b34c-8c69-4aa2-8cd8-77926ea95f3b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:54.368509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 976/1952] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:54.371272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817587a0-81ec-4100-b4d5-7b1b019cc67f service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:54.383184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817587a0-81ec-4100-b4d5-7b1b019cc67f service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:54.392670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b4d54-7174-4873-b08d-c4602a2e3a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:54.392670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b4d54-7174-4873-b08d-c4602a2e3a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:54.392670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b4d54-7174-4873-b08d-c4602a2e3a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:54.392670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b4d54-7174-4873-b08d-c4602a2e3a33 admin admin] PATH_INFO: `/v3/projects/32eddfcb9c764cc883b34df53fb43352/users/4bf5d953814a48eebd3b0ed35bcdcde6/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:54.413863 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b4d54-7174-4873-b08d-c4602a2e3a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32eddfcb9c764cc883b34df53fb43352, user_id=4bf5d953814a48eebd3b0ed35bcdcde6, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:54.416702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b4d54-7174-4873-b08d-c4602a2e3a33 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:54.435749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 977/1953] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:54 2022] PUT /identity/v3/projects/32eddfcb9c764cc883b34df53fb43352/users/4bf5d953814a48eebd3b0ed35bcdcde6/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:54.447371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a744e8-a525-41ab-bc26-57b3dce48edb None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:54.448252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a744e8-a525-41ab-bc26-57b3dce48edb None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:54.448588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a744e8-a525-41ab-bc26-57b3dce48edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:54.501310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-58a744e8-a525-41ab-bc26-57b3dce48edb None None] MFA Rules not processed for user `4bf5d953814a48eebd3b0ed35bcdcde6`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:54.502827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-58a744e8-a525-41ab-bc26-57b3dce48edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:54.594421 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b4d54-7174-4873-b08d-c4602a2e3a33 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:54.597303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 977/1954] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:54.675067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:54.705581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b4d54-7174-4873-b08d-c4602a2e3a33 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:54.711190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35345f28-d9ec-453b-89f3-bf1fddcf9a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:54.712149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345f28-d9ec-453b-89f3-bf1fddcf9a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:54.712549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345f28-d9ec-453b-89f3-bf1fddcf9a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:54.712938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345f28-d9ec-453b-89f3-bf1fddcf9a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:54.714285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35345f28-d9ec-453b-89f3-bf1fddcf9a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:54.716344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35345f28-d9ec-453b-89f3-bf1fddcf9a4f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:54.756927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 978/1955] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:54 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:25:54.758806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a744e8-a525-41ab-bc26-57b3dce48edb None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:54.780302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a744e8-a525-41ab-bc26-57b3dce48edb None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:54.908371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f42fec-cad9-4d04-ad64-4db86f8b34f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:54.908371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f42fec-cad9-4d04-ad64-4db86f8b34f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:54.908371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f42fec-cad9-4d04-ad64-4db86f8b34f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:54.908371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f42fec-cad9-4d04-ad64-4db86f8b34f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:54.908854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f42fec-cad9-4d04-ad64-4db86f8b34f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:54.908854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f42fec-cad9-4d04-ad64-4db86f8b34f6 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:54.936307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 978/1956] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:54 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:54.940411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35345f28-d9ec-453b-89f3-bf1fddcf9a4f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:54.957082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35345f28-d9ec-453b-89f3-bf1fddcf9a4f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:54.968327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83362-c6e5-4711-bc47-cc9535a24a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:54.969192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83362-c6e5-4711-bc47-cc9535a24a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:54.969691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83362-c6e5-4711-bc47-cc9535a24a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:54.970103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c83362-c6e5-4711-bc47-cc9535a24a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:54.971014 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c83362-c6e5-4711-bc47-cc9535a24a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:54.976191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c83362-c6e5-4711-bc47-cc9535a24a42 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:55.014065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 979/1957] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:55.018733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f42fec-cad9-4d04-ad64-4db86f8b34f6 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:55.054077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f42fec-cad9-4d04-ad64-4db86f8b34f6 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:55.071382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d765dbd-de03-4ae0-bfc5-e6e17b83fa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:55.073707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765dbd-de03-4ae0-bfc5-e6e17b83fa63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:55.074011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765dbd-de03-4ae0-bfc5-e6e17b83fa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:55.074656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765dbd-de03-4ae0-bfc5-e6e17b83fa63 admin admin] PATH_INFO: `/v3/projects/9169881466b749c08900ef9f62ddc339/users/1430adda94d947e7b8bf571d02e4a32f/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:55.101236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:55.106492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d765dbd-de03-4ae0-bfc5-e6e17b83fa63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9169881466b749c08900ef9f62ddc339, user_id=1430adda94d947e7b8bf571d02e4a32f, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:55.111953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d765dbd-de03-4ae0-bfc5-e6e17b83fa63 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:55.156241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 979/1958] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:55 2022] PUT /identity/v3/projects/9169881466b749c08900ef9f62ddc339/users/1430adda94d947e7b8bf571d02e4a32f/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:55.162079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83362-c6e5-4711-bc47-cc9535a24a42 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:55.180386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c83362-c6e5-4711-bc47-cc9535a24a42 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:55.299051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235e046-6cde-49d6-af97-ba161fd63bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:55.300084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235e046-6cde-49d6-af97-ba161fd63bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:55.300480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235e046-6cde-49d6-af97-ba161fd63bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:55.301068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235e046-6cde-49d6-af97-ba161fd63bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:55.301916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235e046-6cde-49d6-af97-ba161fd63bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:55.303798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235e046-6cde-49d6-af97-ba161fd63bf5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:55.320231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 980/1959] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:55.321676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d765dbd-de03-4ae0-bfc5-e6e17b83fa63 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:55.373224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d765dbd-de03-4ae0-bfc5-e6e17b83fa63 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:55.381912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709d46d-ecfb-4465-8090-21fbd5b0589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:55.393913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d46d-ecfb-4465-8090-21fbd5b0589a admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:55.394208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d46d-ecfb-4465-8090-21fbd5b0589a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:55.394494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d46d-ecfb-4465-8090-21fbd5b0589a admin admin] PATH_INFO: `/v3/projects/9169881466b749c08900ef9f62ddc339/users/1430adda94d947e7b8bf571d02e4a32f/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:55.405369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709d46d-ecfb-4465-8090-21fbd5b0589a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9169881466b749c08900ef9f62ddc339, user_id=1430adda94d947e7b8bf571d02e4a32f, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:55.412442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709d46d-ecfb-4465-8090-21fbd5b0589a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:55.477353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 980/1960] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:55 2022] PUT /identity/v3/projects/9169881466b749c08900ef9f62ddc339/users/1430adda94d947e7b8bf571d02e4a32f/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:55.482106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769f045-5a06-4e65-924c-b3d7eb940202 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:55.484768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769f045-5a06-4e65-924c-b3d7eb940202 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:55.485167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769f045-5a06-4e65-924c-b3d7eb940202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:55.537506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-3769f045-5a06-4e65-924c-b3d7eb940202 None None] MFA Rules not processed for user `1430adda94d947e7b8bf571d02e4a32f`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:55.539024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3769f045-5a06-4e65-924c-b3d7eb940202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:55.663539 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 981/1961] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:55.675846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709d46d-ecfb-4465-8090-21fbd5b0589a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:55.677801 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9709d46d-ecfb-4465-8090-21fbd5b0589a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:55.748387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709d46d-ecfb-4465-8090-21fbd5b0589a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:55.755907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c0338-4f73-4ec6-a44c-f8a5809c806c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:55.757038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c0338-4f73-4ec6-a44c-f8a5809c806c service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:55.757525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c0338-4f73-4ec6-a44c-f8a5809c806c service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:55.758012 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c0338-4f73-4ec6-a44c-f8a5809c806c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:55.759685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769f045-5a06-4e65-924c-b3d7eb940202 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:55.762770 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3769f045-5a06-4e65-924c-b3d7eb940202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:55.777414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c0338-4f73-4ec6-a44c-f8a5809c806c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:55.782913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c0338-4f73-4ec6-a44c-f8a5809c806c service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:55.805766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 981/1962] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:55.839497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:55.919616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769f045-5a06-4e65-924c-b3d7eb940202 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:55.940158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:55.941583 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:55.942058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:55.942447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] PATH_INFO: `/v3/projects/23a40867c5c14dd5823c481b03448d9b` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:55.944614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a40867c5c14dd5823c481b03448d9b)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:55.947303 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:55.974704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c0338-4f73-4ec6-a44c-f8a5809c806c service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:55.976431 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6a0c0338-4f73-4ec6-a44c-f8a5809c806c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:56.006749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c0338-4f73-4ec6-a44c-f8a5809c806c service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:56.013239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a47e76-14a4-4d0d-afa0-e935be269de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:56.015476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a47e76-14a4-4d0d-afa0-e935be269de7 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.015948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a47e76-14a4-4d0d-afa0-e935be269de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.018573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a47e76-14a4-4d0d-afa0-e935be269de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.099809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a40867c5c14dd5823c481b03448d9b', 'request_id': 'req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:56.115374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a40867c5c14dd5823c481b03448d9b', 'request_id': 'req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:56.143149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a40867c5c14dd5823c481b03448d9b', 'request_id': 'req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:56.169658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] The token cache is being invalidate because project 23a40867c5c14dd5823c481b03448d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:56.169967 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:56.170822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8272e2d3-bb9c-4ac2-8e3a-d47a6e645df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:56.173444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 982/1963] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:55 2022] DELETE /identity/v3/projects/23a40867c5c14dd5823c481b03448d9b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:56.176329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a47e76-14a4-4d0d-afa0-e935be269de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:56.177863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a47e76-14a4-4d0d-afa0-e935be269de7 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:56.179521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce74d0-95bb-4c85-90d5-40c51fb57de4 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.179893 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce74d0-95bb-4c85-90d5-40c51fb57de4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.180281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce74d0-95bb-4c85-90d5-40c51fb57de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.203841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 982/1964] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:25:56.231958 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-37ce74d0-95bb-4c85-90d5-40c51fb57de4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:56.233247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-37ce74d0-95bb-4c85-90d5-40c51fb57de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:56.344298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 983/1965] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:56.346988 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d740d-9b50-413b-a617-1f5eba983ac8 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.347719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d740d-9b50-413b-a617-1f5eba983ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.348183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d740d-9b50-413b-a617-1f5eba983ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.370702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-5c3d740d-9b50-413b-a617-1f5eba983ac8 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:56.373879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5c3d740d-9b50-413b-a617-1f5eba983ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:56.387239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 983/1966] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:56.391378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce74d0-95bb-4c85-90d5-40c51fb57de4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:56.405165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce74d0-95bb-4c85-90d5-40c51fb57de4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:56.418344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76924b3-1ea3-45ec-8c8c-9173f0e89df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:56.419062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76924b3-1ea3-45ec-8c8c-9173f0e89df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.419357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76924b3-1ea3-45ec-8c8c-9173f0e89df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.419644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76924b3-1ea3-45ec-8c8c-9173f0e89df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.420392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76924b3-1ea3-45ec-8c8c-9173f0e89df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:56.422390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76924b3-1ea3-45ec-8c8c-9173f0e89df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:56.425357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76924b3-1ea3-45ec-8c8c-9173f0e89df3 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:56.440665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 984/1967] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:25:56.445922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d740d-9b50-413b-a617-1f5eba983ac8 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:56.457426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d740d-9b50-413b-a617-1f5eba983ac8 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:56.462667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2faac5-2d1f-49af-b1b8-e23ab1a466af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:56.463455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2faac5-2d1f-49af-b1b8-e23ab1a466af admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.463717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2faac5-2d1f-49af-b1b8-e23ab1a466af admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.464076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2faac5-2d1f-49af-b1b8-e23ab1a466af admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.464743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2faac5-2d1f-49af-b1b8-e23ab1a466af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:56.466668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2faac5-2d1f-49af-b1b8-e23ab1a466af admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:56.516007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 984/1968] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:56 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:56.518221 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76924b3-1ea3-45ec-8c8c-9173f0e89df3 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:56.532095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76924b3-1ea3-45ec-8c8c-9173f0e89df3 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:56.586138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:56.615463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3eb67-b603-4c54-bdff-570642b2521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:56.616365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3eb67-b603-4c54-bdff-570642b2521e admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.616659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3eb67-b603-4c54-bdff-570642b2521e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.617003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3eb67-b603-4c54-bdff-570642b2521e admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.617784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3eb67-b603-4c54-bdff-570642b2521e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:56.620066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3eb67-b603-4c54-bdff-570642b2521e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:56.657648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 985/1969] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:56 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:56.661622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2faac5-2d1f-49af-b1b8-e23ab1a466af admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:56.675067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2faac5-2d1f-49af-b1b8-e23ab1a466af admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:56.680680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db48b8b-6933-4196-ac22-3dbc6a25f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:56.681352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db48b8b-6933-4196-ac22-3dbc6a25f142 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.681640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db48b8b-6933-4196-ac22-3dbc6a25f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.681944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db48b8b-6933-4196-ac22-3dbc6a25f142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.682681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db48b8b-6933-4196-ac22-3dbc6a25f142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:56.684334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db48b8b-6933-4196-ac22-3dbc6a25f142 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:56.695081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 985/1970] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:56.699031 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3eb67-b603-4c54-bdff-570642b2521e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:56.709345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3eb67-b603-4c54-bdff-570642b2521e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:56.714934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b38a31-1576-41de-82b0-ebf8153c799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:56.715691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b38a31-1576-41de-82b0-ebf8153c799c admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.716175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b38a31-1576-41de-82b0-ebf8153c799c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.716471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b38a31-1576-41de-82b0-ebf8153c799c admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.717259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b38a31-1576-41de-82b0-ebf8153c799c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:56.718903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b38a31-1576-41de-82b0-ebf8153c799c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:56.730335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 986/1971] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:25:56.734231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db48b8b-6933-4196-ac22-3dbc6a25f142 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:56.745486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db48b8b-6933-4196-ac22-3dbc6a25f142 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:56.750289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef1a06-eae1-4f07-a968-ee6ca7aca175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:56.751188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1a06-eae1-4f07-a968-ee6ca7aca175 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.751473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1a06-eae1-4f07-a968-ee6ca7aca175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.751752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef1a06-eae1-4f07-a968-ee6ca7aca175 admin admin] PATH_INFO: `/v3/projects/7b22e1b72def451ea26f34c0016284ed/users/a2b33070778c40259af1abf7021f3be1/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.766730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef1a06-eae1-4f07-a968-ee6ca7aca175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b22e1b72def451ea26f34c0016284ed, user_id=a2b33070778c40259af1abf7021f3be1, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:56.769440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef1a06-eae1-4f07-a968-ee6ca7aca175 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:56.784523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 986/1972] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:56 2022] PUT /identity/v3/projects/7b22e1b72def451ea26f34c0016284ed/users/a2b33070778c40259af1abf7021f3be1/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:56.795747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016eccf-d618-4097-8786-695ce6613802 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:56.796078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016eccf-d618-4097-8786-695ce6613802 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:56.796367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016eccf-d618-4097-8786-695ce6613802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:56.830848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c016eccf-d618-4097-8786-695ce6613802 None None] MFA Rules not processed for user `a2b33070778c40259af1abf7021f3be1`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:56.832767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c016eccf-d618-4097-8786-695ce6613802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:56.928151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 987/1973] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:56.941444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef1a06-eae1-4f07-a968-ee6ca7aca175 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:56.943888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e9ef1a06-eae1-4f07-a968-ee6ca7aca175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:56.968887 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:57.067150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef1a06-eae1-4f07-a968-ee6ca7aca175 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:57.072214 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6813143-4122-421e-8c0d-1d18fa3b7bcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:57.073403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6813143-4122-421e-8c0d-1d18fa3b7bcc service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:57.073687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6813143-4122-421e-8c0d-1d18fa3b7bcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:57.074076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6813143-4122-421e-8c0d-1d18fa3b7bcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:57.085965 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6813143-4122-421e-8c0d-1d18fa3b7bcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:57.087566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6813143-4122-421e-8c0d-1d18fa3b7bcc service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:57.099754 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 987/1974] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:57.180194 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016eccf-d618-4097-8786-695ce6613802 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:57.181670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c016eccf-d618-4097-8786-695ce6613802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:57.251871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016eccf-d618-4097-8786-695ce6613802 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:57.257090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:57.257991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:57.258284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:57.258569 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] PATH_INFO: `/v3/users/2cb78e93539c4799add7c12014009d2e` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:57.260509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb78e93539c4799add7c12014009d2e)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:57.262658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:57.318599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb78e93539c4799add7c12014009d2e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:57.319547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb78e93539c4799add7c12014009d2e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:57.334481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:57.341176 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb78e93539c4799add7c12014009d2e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:57.345170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb78e93539c4799add7c12014009d2e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:57.357935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb78e93539c4799add7c12014009d2e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:57.376663 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 988/1975] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:57 2022] DELETE /identity/v3/users/2cb78e93539c4799add7c12014009d2e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:57.381298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5aac3-7860-4d7e-bc54-63343480c1d8 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:57.382066 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5aac3-7860-4d7e-bc54-63343480c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:57.382066 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5aac3-7860-4d7e-bc54-63343480c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:57.418010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4ba5aac3-7860-4d7e-bc54-63343480c1d8 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:57.419595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4ba5aac3-7860-4d7e-bc54-63343480c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:57.648319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 988/1976] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:57.682863 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:57.684548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:57.779394 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31775445-1dd3-4e1d-8ab8-7fb71cb3ad54 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:57.783691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fd236-7fd6-40ec-9bbf-d3b9253636a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:57.784602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fd236-7fd6-40ec-9bbf-d3b9253636a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:57.784884 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fd236-7fd6-40ec-9bbf-d3b9253636a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:57.785159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fd236-7fd6-40ec-9bbf-d3b9253636a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:57.800260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fd236-7fd6-40ec-9bbf-d3b9253636a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:57.801818 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fd236-7fd6-40ec-9bbf-d3b9253636a7 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:57.836181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 989/1977] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:25:58.457321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5aac3-7860-4d7e-bc54-63343480c1d8 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:58.459784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4ba5aac3-7860-4d7e-bc54-63343480c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:58.473507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5aac3-7860-4d7e-bc54-63343480c1d8 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:58.479508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:58.480776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:58.481293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:58.481788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] PATH_INFO: `/v3/projects/8bd79247108146108aa90144f49ba1e0` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:58.483211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd79247108146108aa90144f49ba1e0)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:58.485597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:58.545042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd79247108146108aa90144f49ba1e0', 'request_id': 'req-cda309d4-b1c3-4a16-9860-75fb95b354e8'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:58.554755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd79247108146108aa90144f49ba1e0', 'request_id': 'req-cda309d4-b1c3-4a16-9860-75fb95b354e8'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:58.561453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd79247108146108aa90144f49ba1e0', 'request_id': 'req-cda309d4-b1c3-4a16-9860-75fb95b354e8'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:58.573899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] The token cache is being invalidate because project 8bd79247108146108aa90144f49ba1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:58.574121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:58.575104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:58.576682 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 989/1978] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:58 2022] DELETE /identity/v3/projects/8bd79247108146108aa90144f49ba1e0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:58.580884 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fd236-7fd6-40ec-9bbf-d3b9253636a7 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:58.590934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fd236-7fd6-40ec-9bbf-d3b9253636a7 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:58.660305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:58.661204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:58.661492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:58.661777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] PATH_INFO: `/v3/users/ab8d6d23e29d4451bb9c63f1d2e5edb6` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:58.663245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8d6d23e29d4451bb9c63f1d2e5edb6)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:58.665240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:58.753389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8d6d23e29d4451bb9c63f1d2e5edb6'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:58.754863 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8d6d23e29d4451bb9c63f1d2e5edb6'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:58.787460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8d6d23e29d4451bb9c63f1d2e5edb6'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:58.788404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8d6d23e29d4451bb9c63f1d2e5edb6'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:58.797628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8d6d23e29d4451bb9c63f1d2e5edb6'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:58.808892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:58.828512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 990/1979] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:58 2022] DELETE /identity/v3/users/ab8d6d23e29d4451bb9c63f1d2e5edb6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:59.103978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:59.105977 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:59.129190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda309d4-b1c3-4a16-9860-75fb95b354e8 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:59.210975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:59.212136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:59.212463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:59.237047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac34c9-986f-4d3a-855d-281686be8efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:59.238513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac34c9-986f-4d3a-855d-281686be8efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.239047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac34c9-986f-4d3a-855d-281686be8efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.239237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac34c9-986f-4d3a-855d-281686be8efd admin admin] PATH_INFO: `/v3/users/4bf5d953814a48eebd3b0ed35bcdcde6` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.240700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac34c9-986f-4d3a-855d-281686be8efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf5d953814a48eebd3b0ed35bcdcde6)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:59.242645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac34c9-986f-4d3a-855d-281686be8efd admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:59.301868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1ac34c9-986f-4d3a-855d-281686be8efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf5d953814a48eebd3b0ed35bcdcde6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:59.317809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1ac34c9-986f-4d3a-855d-281686be8efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf5d953814a48eebd3b0ed35bcdcde6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:59.318511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1ac34c9-986f-4d3a-855d-281686be8efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf5d953814a48eebd3b0ed35bcdcde6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:59.320185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee99f92-b7c1-4dae-854a-bd114ce25da9 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:59.329440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1ac34c9-986f-4d3a-855d-281686be8efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf5d953814a48eebd3b0ed35bcdcde6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:59.329699 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:59.330639 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.330940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.331269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] PATH_INFO: `/v3/projects/3a62f0a6e9eb48718ce8b43ef2c7ae73` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.332789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a62f0a6e9eb48718ce8b43ef2c7ae73)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:59.334828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:59.340050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1ac34c9-986f-4d3a-855d-281686be8efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf5d953814a48eebd3b0ed35bcdcde6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:59.346521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 990/1980] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:25:59 2022] DELETE /identity/v3/users/4bf5d953814a48eebd3b0ed35bcdcde6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:59.351564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94452c57-faea-499d-b663-57e755d471f7 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.351949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94452c57-faea-499d-b663-57e755d471f7 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.352566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94452c57-faea-499d-b663-57e755d471f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.374415 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-94452c57-faea-499d-b663-57e755d471f7 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:59.375886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-94452c57-faea-499d-b663-57e755d471f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:59.402747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a62f0a6e9eb48718ce8b43ef2c7ae73', 'request_id': 'req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:59.413379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a62f0a6e9eb48718ce8b43ef2c7ae73', 'request_id': 'req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:59.421381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a62f0a6e9eb48718ce8b43ef2c7ae73', 'request_id': 'req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:59.435830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] The token cache is being invalidate because project 3a62f0a6e9eb48718ce8b43ef2c7ae73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:25:59.436108 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:59.436769 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-13b061e6-c1af-4fcc-8ba9-24e1f72731c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:25:59.440449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 991/1981] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:59 2022] DELETE /identity/v3/projects/3a62f0a6e9eb48718ce8b43ef2c7ae73 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:25:59.444127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487227d9-7920-4e0e-bc48-ec28e33bebf5 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.444526 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487227d9-7920-4e0e-bc48-ec28e33bebf5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.446142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487227d9-7920-4e0e-bc48-ec28e33bebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.476638 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 991/1982] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:25:59.480566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-487227d9-7920-4e0e-bc48-ec28e33bebf5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:59.482484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-487227d9-7920-4e0e-bc48-ec28e33bebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:59.487612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94452c57-faea-499d-b663-57e755d471f7 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:59.489264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-94452c57-faea-499d-b663-57e755d471f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:59.554353 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 992/1983] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:59.555036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94452c57-faea-499d-b663-57e755d471f7 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:59.567195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c72d9-5419-409d-a92a-bd9a928ca1d9 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.569980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c72d9-5419-409d-a92a-bd9a928ca1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.570427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c72d9-5419-409d-a92a-bd9a928ca1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.576621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:59.591565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a70c72d9-5419-409d-a92a-bd9a928ca1d9 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:25:59.592862 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a70c72d9-5419-409d-a92a-bd9a928ca1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:59.602727 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 993/1984] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:25:59.607249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c72d9-5419-409d-a92a-bd9a928ca1d9 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:59.616571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c72d9-5419-409d-a92a-bd9a928ca1d9 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:59.621666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ee1fb-7f82-4ad5-972c-493019922655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:59.622225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47650da0-0934-41a7-8043-8bf8b5f84d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:59.622350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ee1fb-7f82-4ad5-972c-493019922655 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.622631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ee1fb-7f82-4ad5-972c-493019922655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.622907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ee1fb-7f82-4ad5-972c-493019922655 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.623185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47650da0-0934-41a7-8043-8bf8b5f84d3c service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.623535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47650da0-0934-41a7-8043-8bf8b5f84d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.623701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ee1fb-7f82-4ad5-972c-493019922655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:25:59.623948 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47650da0-0934-41a7-8043-8bf8b5f84d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.624070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ee1fb-7f82-4ad5-972c-493019922655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:59.625645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ee1fb-7f82-4ad5-972c-493019922655 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:59.633627 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47650da0-0934-41a7-8043-8bf8b5f84d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:59.635170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47650da0-0934-41a7-8043-8bf8b5f84d3c service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:59.639365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 994/1985] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:25:59.643463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ee1fb-7f82-4ad5-972c-493019922655 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:59.647613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 992/1986] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:25:59.654858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ee1fb-7f82-4ad5-972c-493019922655 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:59.660438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f97c4-b090-49d9-9cd4-7d3d81d2bf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:59.661654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f97c4-b090-49d9-9cd4-7d3d81d2bf57 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.662187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f97c4-b090-49d9-9cd4-7d3d81d2bf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.662652 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f97c4-b090-49d9-9cd4-7d3d81d2bf57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.663469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f97c4-b090-49d9-9cd4-7d3d81d2bf57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:59.667525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f97c4-b090-49d9-9cd4-7d3d81d2bf57 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:59.673777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:25:59.708016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 995/1987] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:25:59 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:59.711380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47650da0-0934-41a7-8043-8bf8b5f84d3c service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:59.722136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47650da0-0934-41a7-8043-8bf8b5f84d3c service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:59.800813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fe178-6185-4926-8444-5b526cabebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:59.801582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fe178-6185-4926-8444-5b526cabebde admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.802321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fe178-6185-4926-8444-5b526cabebde admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.802713 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fe178-6185-4926-8444-5b526cabebde admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.803738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fe178-6185-4926-8444-5b526cabebde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:59.805836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fe178-6185-4926-8444-5b526cabebde admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:59.841005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 993/1988] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:25:59 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:25:59.844956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f97c4-b090-49d9-9cd4-7d3d81d2bf57 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:59.856622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f97c4-b090-49d9-9cd4-7d3d81d2bf57 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:59.861746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04104e-053e-48b9-9f9c-c5418e97fbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:59.862635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04104e-053e-48b9-9f9c-c5418e97fbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.864241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04104e-053e-48b9-9f9c-c5418e97fbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.864701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04104e-053e-48b9-9f9c-c5418e97fbe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.866215 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04104e-053e-48b9-9f9c-c5418e97fbe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:59.868146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04104e-053e-48b9-9f9c-c5418e97fbe0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:59.880726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 996/1989] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:59.884385 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fe178-6185-4926-8444-5b526cabebde admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:59.897138 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fe178-6185-4926-8444-5b526cabebde admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:59.902375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46447bcb-b96e-4e9f-a0fc-a4f5cd020968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:59.903048 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46447bcb-b96e-4e9f-a0fc-a4f5cd020968 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.903349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46447bcb-b96e-4e9f-a0fc-a4f5cd020968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.903612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46447bcb-b96e-4e9f-a0fc-a4f5cd020968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.904614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46447bcb-b96e-4e9f-a0fc-a4f5cd020968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:59.906226 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46447bcb-b96e-4e9f-a0fc-a4f5cd020968 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:59.919198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 994/1990] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:25:59.923807 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04104e-053e-48b9-9f9c-c5418e97fbe0 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:59.935097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04104e-053e-48b9-9f9c-c5418e97fbe0 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:25:59.940424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fab858-c4ff-42f2-8253-bf01d1613e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:25:59.941332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fab858-c4ff-42f2-8253-bf01d1613e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:25:59.941811 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fab858-c4ff-42f2-8253-bf01d1613e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:25:59.942104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fab858-c4ff-42f2-8253-bf01d1613e1b admin admin] PATH_INFO: `/v3/projects/74ea835f4ccb4bc9960a580bb5acd688/users/64b847ca10624b368fb204402dba14eb/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:25:59.963508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fab858-c4ff-42f2-8253-bf01d1613e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ea835f4ccb4bc9960a580bb5acd688, user_id=64b847ca10624b368fb204402dba14eb, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:25:59.966475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fab858-c4ff-42f2-8253-bf01d1613e1b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:25:59.980947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46447bcb-b96e-4e9f-a0fc-a4f5cd020968 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:25:59.981857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 997/1991] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:25:59 2022] PUT /identity/v3/projects/74ea835f4ccb4bc9960a580bb5acd688/users/64b847ca10624b368fb204402dba14eb/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:25:59.985001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-46447bcb-b96e-4e9f-a0fc-a4f5cd020968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:25:59.999219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada74c2f-5b09-4af5-af41-f031ad3d5790 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:00.000325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada74c2f-5b09-4af5-af41-f031ad3d5790 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:00.001489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada74c2f-5b09-4af5-af41-f031ad3d5790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:00.021314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46447bcb-b96e-4e9f-a0fc-a4f5cd020968 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:00.052386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ada74c2f-5b09-4af5-af41-f031ad3d5790 None None] MFA Rules not processed for user `64b847ca10624b368fb204402dba14eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:00.055370 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ada74c2f-5b09-4af5-af41-f031ad3d5790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:00.126863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:00.128219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:00.128618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:00.129080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] PATH_INFO: `/v3/projects/32eddfcb9c764cc883b34df53fb43352` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:00.131125 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32eddfcb9c764cc883b34df53fb43352)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:00.133800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:00.202485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 998/1992] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:25:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:00.207289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada74c2f-5b09-4af5-af41-f031ad3d5790 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:00.208886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:00.223226 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32eddfcb9c764cc883b34df53fb43352', 'request_id': 'req-22d43699-637d-4417-852a-808e5c8e58c6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:00.236169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada74c2f-5b09-4af5-af41-f031ad3d5790 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:00.238455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32eddfcb9c764cc883b34df53fb43352', 'request_id': 'req-22d43699-637d-4417-852a-808e5c8e58c6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:00.253708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32eddfcb9c764cc883b34df53fb43352', 'request_id': 'req-22d43699-637d-4417-852a-808e5c8e58c6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:00.272832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] The token cache is being invalidate because project 32eddfcb9c764cc883b34df53fb43352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:00.273480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:00.275245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:00.279330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 995/1993] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:25:59 2022] DELETE /identity/v3/projects/32eddfcb9c764cc883b34df53fb43352 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:00.283711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:00.289702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:00.343706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1846e17-2631-4268-9d29-fd9ab484e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:00.344629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1846e17-2631-4268-9d29-fd9ab484e7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:00.345032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1846e17-2631-4268-9d29-fd9ab484e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:00.345797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1846e17-2631-4268-9d29-fd9ab484e7e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:00.346650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1846e17-2631-4268-9d29-fd9ab484e7e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:00.350056 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1846e17-2631-4268-9d29-fd9ab484e7e7 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:00.400765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 999/1994] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:00 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:00.403016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1846e17-2631-4268-9d29-fd9ab484e7e7 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:00.409688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c1846e17-2631-4268-9d29-fd9ab484e7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:00.445152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d43699-637d-4417-852a-808e5c8e58c6 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:00.465273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:00.539095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:00.540046 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:00.540338 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:00.540618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] PATH_INFO: `/v3/users/1430adda94d947e7b8bf571d02e4a32f` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:00.542672 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1430adda94d947e7b8bf571d02e4a32f)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:00.545020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:00.549358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1846e17-2631-4268-9d29-fd9ab484e7e7 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:00.562623 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b70e7-ca20-4f85-b0e9-c402e24197a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:00.564227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b70e7-ca20-4f85-b0e9-c402e24197a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:00.566200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b70e7-ca20-4f85-b0e9-c402e24197a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:00.566734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b70e7-ca20-4f85-b0e9-c402e24197a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:00.569511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b70e7-ca20-4f85-b0e9-c402e24197a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:00.573629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b70e7-ca20-4f85-b0e9-c402e24197a6 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:00.620980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1000/1995] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:00 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:00.623649 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1430adda94d947e7b8bf571d02e4a32f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:00.624731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b70e7-ca20-4f85-b0e9-c402e24197a6 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:00.636555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b70e7-ca20-4f85-b0e9-c402e24197a6 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:00.641458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12883168-a610-4dec-a7b0-5437ed832e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:00.642144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12883168-a610-4dec-a7b0-5437ed832e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:00.642435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12883168-a610-4dec-a7b0-5437ed832e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:00.642719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12883168-a610-4dec-a7b0-5437ed832e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:00.643525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1430adda94d947e7b8bf571d02e4a32f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:00.643641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12883168-a610-4dec-a7b0-5437ed832e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:00.644296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1430adda94d947e7b8bf571d02e4a32f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:00.645239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12883168-a610-4dec-a7b0-5437ed832e7f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:00.656646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1430adda94d947e7b8bf571d02e4a32f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:00.660162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1001/1996] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:00.661919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12883168-a610-4dec-a7b0-5437ed832e7f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:00.663739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-12883168-a610-4dec-a7b0-5437ed832e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:00.673549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:00.678111 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1430adda94d947e7b8bf571d02e4a32f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:00.678991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12883168-a610-4dec-a7b0-5437ed832e7f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:00.686911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba7979-9bbd-43d4-a070-a69095070ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:00.687976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba7979-9bbd-43d4-a070-a69095070ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:00.688299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba7979-9bbd-43d4-a070-a69095070ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:00.688584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba7979-9bbd-43d4-a070-a69095070ee0 admin admin] PATH_INFO: `/v3/projects/fe4769e6b31843dcb21d233394d813e5/users/22aaf4508305415285d2f13d9f5b9ee0/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:00.692255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 996/1997] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:00 2022] DELETE /identity/v3/users/1430adda94d947e7b8bf571d02e4a32f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:00.718868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba7979-9bbd-43d4-a070-a69095070ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4769e6b31843dcb21d233394d813e5, user_id=22aaf4508305415285d2f13d9f5b9ee0, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:00.721830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba7979-9bbd-43d4-a070-a69095070ee0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:00.744724 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1002/1998] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:00 2022] PUT /identity/v3/projects/fe4769e6b31843dcb21d233394d813e5/users/22aaf4508305415285d2f13d9f5b9ee0/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:00.746267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:00.821846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8accd-91b9-46cd-bfe4-737335a7509a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:00.906707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c78e99-5e76-4a9e-a8d4-b4a276e56ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:00.907841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78e99-5e76-4a9e-a8d4-b4a276e56ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:00.907841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78e99-5e76-4a9e-a8d4-b4a276e56ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:00.908412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78e99-5e76-4a9e-a8d4-b4a276e56ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:00.909511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78e99-5e76-4a9e-a8d4-b4a276e56ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:00.911190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78e99-5e76-4a9e-a8d4-b4a276e56ba1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:00.922324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 997/1999] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:00.926464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba7979-9bbd-43d4-a070-a69095070ee0 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:00.937527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba7979-9bbd-43d4-a070-a69095070ee0 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:00.943746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c7590-47f4-4f6b-a0db-63e044b954e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:00.944694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7590-47f4-4f6b-a0db-63e044b954e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:00.944985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7590-47f4-4f6b-a0db-63e044b954e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:00.945270 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7590-47f4-4f6b-a0db-63e044b954e8 admin admin] PATH_INFO: `/v3/projects/fe4769e6b31843dcb21d233394d813e5/users/22aaf4508305415285d2f13d9f5b9ee0/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:00.947399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c7590-47f4-4f6b-a0db-63e044b954e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4769e6b31843dcb21d233394d813e5, user_id=22aaf4508305415285d2f13d9f5b9ee0, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:00.950486 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c7590-47f4-4f6b-a0db-63e044b954e8 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:00.963563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1003/2000] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:00 2022] PUT /identity/v3/projects/fe4769e6b31843dcb21d233394d813e5/users/22aaf4508305415285d2f13d9f5b9ee0/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:00.974058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8adc90-46ea-46eb-af62-feb1516feb4b None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:00.974058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8adc90-46ea-46eb-af62-feb1516feb4b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:00.974431 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8adc90-46ea-46eb-af62-feb1516feb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.006336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-5d8adc90-46ea-46eb-af62-feb1516feb4b None None] MFA Rules not processed for user `22aaf4508305415285d2f13d9f5b9ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:01.007703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5d8adc90-46ea-46eb-af62-feb1516feb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:01.090234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 998/2001] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:01.101904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c7590-47f4-4f6b-a0db-63e044b954e8 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.104481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bf1c7590-47f4-4f6b-a0db-63e044b954e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:01.198207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c7590-47f4-4f6b-a0db-63e044b954e8 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.202756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38976282-89e4-448e-a93e-916f15c7c57a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.204103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38976282-89e4-448e-a93e-916f15c7c57a service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.204462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38976282-89e4-448e-a93e-916f15c7c57a service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.204813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38976282-89e4-448e-a93e-916f15c7c57a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.215556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38976282-89e4-448e-a93e-916f15c7c57a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.217220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38976282-89e4-448e-a93e-916f15c7c57a service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.227887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1004/2002] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:01.310130 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8adc90-46ea-46eb-af62-feb1516feb4b None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.320228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8adc90-46ea-46eb-af62-feb1516feb4b None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.323957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bc16d-e14f-4376-aa1f-096a9098157c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.324961 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc16d-e14f-4376-aa1f-096a9098157c service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.325245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc16d-e14f-4376-aa1f-096a9098157c service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.325525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc16d-e14f-4376-aa1f-096a9098157c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.327316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-198bc16d-e14f-4376-aa1f-096a9098157c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:01.354868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:01.399734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bc16d-e14f-4376-aa1f-096a9098157c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.401887 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bc16d-e14f-4376-aa1f-096a9098157c service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.412915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 999/2003] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:01.517621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38976282-89e4-448e-a93e-916f15c7c57a service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.519074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-38976282-89e4-448e-a93e-916f15c7c57a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:01.610499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38976282-89e4-448e-a93e-916f15c7c57a service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.616820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.617694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.617981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.618262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] PATH_INFO: `/v3/projects/9169881466b749c08900ef9f62ddc339` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.620177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9169881466b749c08900ef9f62ddc339)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.622171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.641225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:01.688570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9169881466b749c08900ef9f62ddc339', 'request_id': 'req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:01.698339 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9169881466b749c08900ef9f62ddc339', 'request_id': 'req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:01.706516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9169881466b749c08900ef9f62ddc339', 'request_id': 'req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:01.720835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] The token cache is being invalidate because project 9169881466b749c08900ef9f62ddc339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:01.721135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:01.721840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:01.723822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1005/2004] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:01 2022] DELETE /identity/v3/projects/9169881466b749c08900ef9f62ddc339 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:01.729394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3133-0c91-40cd-b14d-fe3ad6beeb7a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.729881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3133-0c91-40cd-b14d-fe3ad6beeb7a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.730179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3133-0c91-40cd-b14d-fe3ad6beeb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.749383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.752140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-bd5f3133-0c91-40cd-b14d-fe3ad6beeb7a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:01.753464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:01.753608 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-bd5f3133-0c91-40cd-b14d-fe3ad6beeb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:01.835747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd04dd8-3a21-4a33-bfbc-056ceda4e6c5 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.841446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2eaf58-4e28-48e3-9e16-cfa88dcf8627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.842475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eaf58-4e28-48e3-9e16-cfa88dcf8627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.842995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eaf58-4e28-48e3-9e16-cfa88dcf8627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.843548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eaf58-4e28-48e3-9e16-cfa88dcf8627 admin admin] PATH_INFO: `/v3/users/64b847ca10624b368fb204402dba14eb` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.845048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2eaf58-4e28-48e3-9e16-cfa88dcf8627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b847ca10624b368fb204402dba14eb)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.846701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1000/2005] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:01.847276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2eaf58-4e28-48e3-9e16-cfa88dcf8627 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.855533 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01108bb5-ab36-4442-86d4-b013361586c2 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.856098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01108bb5-ab36-4442-86d4-b013361586c2 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.856458 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01108bb5-ab36-4442-86d4-b013361586c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.883187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-01108bb5-ab36-4442-86d4-b013361586c2 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:01.884609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-01108bb5-ab36-4442-86d4-b013361586c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:01.896276 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1001/2006] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:01.900587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01108bb5-ab36-4442-86d4-b013361586c2 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.910864 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01108bb5-ab36-4442-86d4-b013361586c2 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.911821 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-cc2eaf58-4e28-48e3-9e16-cfa88dcf8627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b847ca10624b368fb204402dba14eb'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:01.912766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-cc2eaf58-4e28-48e3-9e16-cfa88dcf8627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b847ca10624b368fb204402dba14eb'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:01.916743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307925a8-936d-4fa8-a38c-5966a17dd03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.917586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307925a8-936d-4fa8-a38c-5966a17dd03f admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.918052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307925a8-936d-4fa8-a38c-5966a17dd03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.918442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307925a8-936d-4fa8-a38c-5966a17dd03f admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.919428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307925a8-936d-4fa8-a38c-5966a17dd03f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:01.919750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307925a8-936d-4fa8-a38c-5966a17dd03f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.921615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307925a8-936d-4fa8-a38c-5966a17dd03f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.927111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-cc2eaf58-4e28-48e3-9e16-cfa88dcf8627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b847ca10624b368fb204402dba14eb'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:01.928044 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-cc2eaf58-4e28-48e3-9e16-cfa88dcf8627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b847ca10624b368fb204402dba14eb'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:01.936796 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1002/2007] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:26:01.940304 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-cc2eaf58-4e28-48e3-9e16-cfa88dcf8627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b847ca10624b368fb204402dba14eb'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:01.942055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307925a8-936d-4fa8-a38c-5966a17dd03f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.944084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-307925a8-936d-4fa8-a38c-5966a17dd03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:01.959318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307925a8-936d-4fa8-a38c-5966a17dd03f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.963775 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1006/2008] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:01 2022] DELETE /identity/v3/users/64b847ca10624b368fb204402dba14eb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:01.968629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2393c3e-924a-4985-9942-7317b840af8e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.968858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68c0d3-f264-4e31-ab93-fcefbe5c1256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.969022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2393c3e-924a-4985-9942-7317b840af8e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.969257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2393c3e-924a-4985-9942-7317b840af8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.969815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68c0d3-f264-4e31-ab93-fcefbe5c1256 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.970202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68c0d3-f264-4e31-ab93-fcefbe5c1256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.970515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68c0d3-f264-4e31-ab93-fcefbe5c1256 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.971449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68c0d3-f264-4e31-ab93-fcefbe5c1256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.973567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68c0d3-f264-4e31-ab93-fcefbe5c1256 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.991277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a2393c3e-924a-4985-9942-7317b840af8e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:01.993248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a2393c3e-924a-4985-9942-7317b840af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.008978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1003/2009] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:01 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:02.013790 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:02.014617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68c0d3-f264-4e31-ab93-fcefbe5c1256 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.077270 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1007/2010] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.088819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2393c3e-924a-4985-9942-7317b840af8e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.090897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a2393c3e-924a-4985-9942-7317b840af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.095415 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68c0d3-f264-4e31-ab93-fcefbe5c1256 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.100735 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f81993-651a-4c12-8812-0db4d9cdd74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.101554 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f81993-651a-4c12-8812-0db4d9cdd74d admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.101912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f81993-651a-4c12-8812-0db4d9cdd74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.102269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f81993-651a-4c12-8812-0db4d9cdd74d admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.103060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f81993-651a-4c12-8812-0db4d9cdd74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.105302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f81993-651a-4c12-8812-0db4d9cdd74d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.128570 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1004/2011] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:02.132358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f81993-651a-4c12-8812-0db4d9cdd74d admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.143408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f81993-651a-4c12-8812-0db4d9cdd74d admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.149512 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fc154-6403-4852-a3cc-99931aa86b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.150314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc154-6403-4852-a3cc-99931aa86b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.150668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc154-6403-4852-a3cc-99931aa86b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.151453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc154-6403-4852-a3cc-99931aa86b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.151939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fc154-6403-4852-a3cc-99931aa86b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.153653 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fc154-6403-4852-a3cc-99931aa86b41 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.161217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:02.162499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2393c3e-924a-4985-9942-7317b840af8e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.174899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1005/2012] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:02.176007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fc154-6403-4852-a3cc-99931aa86b41 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.189819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fc154-6403-4852-a3cc-99931aa86b41 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.195358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba99c07-56a0-4d16-a719-c13977b11a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.196160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba99c07-56a0-4d16-a719-c13977b11a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.196545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba99c07-56a0-4d16-a719-c13977b11a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.196957 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba99c07-56a0-4d16-a719-c13977b11a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.198372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba99c07-56a0-4d16-a719-c13977b11a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.200362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba99c07-56a0-4d16-a719-c13977b11a67 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.214935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1006/2013] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:02.219281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba99c07-56a0-4d16-a719-c13977b11a67 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.237102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba99c07-56a0-4d16-a719-c13977b11a67 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.244812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6b770-3c95-4f5d-b63d-9fb1d33694e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.247060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5bc3d-428a-442a-b6e6-70d85a723fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.247206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6b770-3c95-4f5d-b63d-9fb1d33694e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.247206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6b770-3c95-4f5d-b63d-9fb1d33694e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.247346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5bc3d-428a-442a-b6e6-70d85a723fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.247418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6b770-3c95-4f5d-b63d-9fb1d33694e1 admin admin] PATH_INFO: `/v3/projects/ffbba4e2c1b94d6e95f53f7a8238ac5c/users/bfc2bb5edbbd4337a1c91ace5c2ec865/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.247504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5bc3d-428a-442a-b6e6-70d85a723fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.247504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5bc3d-428a-442a-b6e6-70d85a723fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.258268 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5bc3d-428a-442a-b6e6-70d85a723fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.259943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5bc3d-428a-442a-b6e6-70d85a723fe2 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.268829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6b770-3c95-4f5d-b63d-9fb1d33694e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbba4e2c1b94d6e95f53f7a8238ac5c, user_id=bfc2bb5edbbd4337a1c91ace5c2ec865, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.272240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6b770-3c95-4f5d-b63d-9fb1d33694e1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.273772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1008/2014] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:26:02.291794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1007/2015] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:02 2022] PUT /identity/v3/projects/ffbba4e2c1b94d6e95f53f7a8238ac5c/users/bfc2bb5edbbd4337a1c91ace5c2ec865/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:02.303270 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78237419-ab9c-4c7e-95dc-0ee1c4ffdc84 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.303559 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78237419-ab9c-4c7e-95dc-0ee1c4ffdc84 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.303835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78237419-ab9c-4c7e-95dc-0ee1c4ffdc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.335500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-78237419-ab9c-4c7e-95dc-0ee1c4ffdc84 None None] MFA Rules not processed for user `bfc2bb5edbbd4337a1c91ace5c2ec865`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.337025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-78237419-ab9c-4c7e-95dc-0ee1c4ffdc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.445035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1009/2016] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:02.461240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6b770-3c95-4f5d-b63d-9fb1d33694e1 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.466855 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9df6b770-3c95-4f5d-b63d-9fb1d33694e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.567030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6b770-3c95-4f5d-b63d-9fb1d33694e1 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.570944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711051e3-02c4-49e2-84e6-182026beff50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.571808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711051e3-02c4-49e2-84e6-182026beff50 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.572733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711051e3-02c4-49e2-84e6-182026beff50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.573087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711051e3-02c4-49e2-84e6-182026beff50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.583027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711051e3-02c4-49e2-84e6-182026beff50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.584726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711051e3-02c4-49e2-84e6-182026beff50 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.595555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1008/2017] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:02.629939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78237419-ab9c-4c7e-95dc-0ee1c4ffdc84 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.632196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-78237419-ab9c-4c7e-95dc-0ee1c4ffdc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.657284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:02.736374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78237419-ab9c-4c7e-95dc-0ee1c4ffdc84 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.742603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.744740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.745042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.745343 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] PATH_INFO: `/v3/projects/74ea835f4ccb4bc9960a580bb5acd688` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.748600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ea835f4ccb4bc9960a580bb5acd688)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.750549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.833990 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ea835f4ccb4bc9960a580bb5acd688', 'request_id': 'req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:02.843328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ea835f4ccb4bc9960a580bb5acd688', 'request_id': 'req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:02.860961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ea835f4ccb4bc9960a580bb5acd688', 'request_id': 'req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:02.876825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] The token cache is being invalidate because project 74ea835f4ccb4bc9960a580bb5acd688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:02.877676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:02.878226 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:02.883058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1010/2018] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:02 2022] DELETE /identity/v3/projects/74ea835f4ccb4bc9960a580bb5acd688 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:02.884576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711051e3-02c4-49e2-84e6-182026beff50 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.897039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711051e3-02c4-49e2-84e6-182026beff50 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.007220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec5ff4-d6c5-4dcb-be56-949438874ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.008475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec5ff4-d6c5-4dcb-be56-949438874ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.010613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec5ff4-d6c5-4dcb-be56-949438874ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.011128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec5ff4-d6c5-4dcb-be56-949438874ad5 admin admin] PATH_INFO: `/v3/users/22aaf4508305415285d2f13d9f5b9ee0` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.015346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec5ff4-d6c5-4dcb-be56-949438874ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22aaf4508305415285d2f13d9f5b9ee0)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.026559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec5ff4-d6c5-4dcb-be56-949438874ad5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.136194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ddec5ff4-d6c5-4dcb-be56-949438874ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22aaf4508305415285d2f13d9f5b9ee0'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:03.149686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ddec5ff4-d6c5-4dcb-be56-949438874ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22aaf4508305415285d2f13d9f5b9ee0'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:03.151189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ddec5ff4-d6c5-4dcb-be56-949438874ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22aaf4508305415285d2f13d9f5b9ee0'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:03.157266 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:03.165093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ddec5ff4-d6c5-4dcb-be56-949438874ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22aaf4508305415285d2f13d9f5b9ee0'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:03.177005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ddec5ff4-d6c5-4dcb-be56-949438874ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22aaf4508305415285d2f13d9f5b9ee0'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:03.188220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1009/2019] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:02 2022] DELETE /identity/v3/users/22aaf4508305415285d2f13d9f5b9ee0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:03.573009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.575391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:03.591001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcfc12-09c4-430b-9ac2-b8871aae3c85 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.679759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.680662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.680944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.681220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] PATH_INFO: `/v3/projects/fe4769e6b31843dcb21d233394d813e5` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.682470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4769e6b31843dcb21d233394d813e5)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.684416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.726394 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:03.734200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4769e6b31843dcb21d233394d813e5', 'request_id': 'req-602de7c3-00de-4211-9bd7-15a852afa45b'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:03.742621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4769e6b31843dcb21d233394d813e5', 'request_id': 'req-602de7c3-00de-4211-9bd7-15a852afa45b'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:03.748932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4769e6b31843dcb21d233394d813e5', 'request_id': 'req-602de7c3-00de-4211-9bd7-15a852afa45b'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:03.761651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] The token cache is being invalidate because project fe4769e6b31843dcb21d233394d813e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:03.762188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:03.762957 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-602de7c3-00de-4211-9bd7-15a852afa45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:03.764589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1011/2020] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:03 2022] DELETE /identity/v3/projects/fe4769e6b31843dcb21d233394d813e5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:03.770818 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410ff00-b29e-460c-9f78-2e451376c202 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.771317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410ff00-b29e-460c-9f78-2e451376c202 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.771816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410ff00-b29e-460c-9f78-2e451376c202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.794341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2410ff00-b29e-460c-9f78-2e451376c202 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:03.795566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2410ff00-b29e-460c-9f78-2e451376c202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:03.870382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1010/2021] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:03.873761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80287f53-420f-4788-9c67-aefd7658467a None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.874083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80287f53-420f-4788-9c67-aefd7658467a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.874409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80287f53-420f-4788-9c67-aefd7658467a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.904537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-80287f53-420f-4788-9c67-aefd7658467a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:03.905792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-80287f53-420f-4788-9c67-aefd7658467a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:03.914422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1012/2022] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:03.919088 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410ff00-b29e-460c-9f78-2e451376c202 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.929736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410ff00-b29e-460c-9f78-2e451376c202 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.935352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee86d0-e133-4c02-b70d-93585ce5e579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.936176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee86d0-e133-4c02-b70d-93585ce5e579 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.936540 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee86d0-e133-4c02-b70d-93585ce5e579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.936893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee86d0-e133-4c02-b70d-93585ce5e579 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.937719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee86d0-e133-4c02-b70d-93585ce5e579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:03.938110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee86d0-e133-4c02-b70d-93585ce5e579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.941264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee86d0-e133-4c02-b70d-93585ce5e579 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.960468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1011/2023] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:03.961857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80287f53-420f-4788-9c67-aefd7658467a None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.972246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80287f53-420f-4788-9c67-aefd7658467a None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.977488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd62fe-09be-46a1-9163-a37f22a3ccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.978706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd62fe-09be-46a1-9163-a37f22a3ccc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.979075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd62fe-09be-46a1-9163-a37f22a3ccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.979783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd62fe-09be-46a1-9163-a37f22a3ccc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.980217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd62fe-09be-46a1-9163-a37f22a3ccc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.982249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd62fe-09be-46a1-9163-a37f22a3ccc0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.018225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1013/2024] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:03 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:04.022104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee86d0-e133-4c02-b70d-93585ce5e579 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.038489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee86d0-e133-4c02-b70d-93585ce5e579 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.112614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848e271-6e7c-4629-9a7c-8202868ee676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.113310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848e271-6e7c-4629-9a7c-8202868ee676 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.113595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848e271-6e7c-4629-9a7c-8202868ee676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.114016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848e271-6e7c-4629-9a7c-8202868ee676 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.114758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848e271-6e7c-4629-9a7c-8202868ee676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.116716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848e271-6e7c-4629-9a7c-8202868ee676 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.148488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1012/2025] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:04 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:04.153108 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd62fe-09be-46a1-9163-a37f22a3ccc0 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.167476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd62fe-09be-46a1-9163-a37f22a3ccc0 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.176392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb4563-4e95-4294-a81c-ac14a6210c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.177093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4563-4e95-4294-a81c-ac14a6210c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.177555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4563-4e95-4294-a81c-ac14a6210c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.177850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb4563-4e95-4294-a81c-ac14a6210c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.178627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb4563-4e95-4294-a81c-ac14a6210c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.180443 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb4563-4e95-4294-a81c-ac14a6210c97 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.196701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1014/2026] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:04.197263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848e271-6e7c-4629-9a7c-8202868ee676 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.210272 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848e271-6e7c-4629-9a7c-8202868ee676 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.217686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701c8b2-e43f-455a-b3c1-1f101da7b009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.218914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c8b2-e43f-455a-b3c1-1f101da7b009 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.219206 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c8b2-e43f-455a-b3c1-1f101da7b009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.219486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c8b2-e43f-455a-b3c1-1f101da7b009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.220252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701c8b2-e43f-455a-b3c1-1f101da7b009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.222525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b701c8b2-e43f-455a-b3c1-1f101da7b009 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.237621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1013/2027] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:04.241251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb4563-4e95-4294-a81c-ac14a6210c97 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.257599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb4563-4e95-4294-a81c-ac14a6210c97 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.264115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f8fa1-da2f-44f6-ab0f-e5c59e53e126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.265031 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f8fa1-da2f-44f6-ab0f-e5c59e53e126 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.265326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f8fa1-da2f-44f6-ab0f-e5c59e53e126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.265753 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f8fa1-da2f-44f6-ab0f-e5c59e53e126 admin admin] PATH_INFO: `/v3/projects/c520573dfe06412bb18459718b9e4b17/users/46d57f08982847ff9771802e3cbd4297/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.287904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f8fa1-da2f-44f6-ab0f-e5c59e53e126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c520573dfe06412bb18459718b9e4b17, user_id=46d57f08982847ff9771802e3cbd4297, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.290610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f8fa1-da2f-44f6-ab0f-e5c59e53e126 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.322980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1015/2028] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:04 2022] PUT /identity/v3/projects/c520573dfe06412bb18459718b9e4b17/users/46d57f08982847ff9771802e3cbd4297/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:04.328567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adce59-c4c4-4adf-8265-8ce50aec5081 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.328789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adce59-c4c4-4adf-8265-8ce50aec5081 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.329053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adce59-c4c4-4adf-8265-8ce50aec5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.364761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-b8adce59-c4c4-4adf-8265-8ce50aec5081 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:04.366571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b8adce59-c4c4-4adf-8265-8ce50aec5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:04.449451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.487019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1014/2029] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:04.500128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f8fa1-da2f-44f6-ab0f-e5c59e53e126 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.501996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-734f8fa1-da2f-44f6-ab0f-e5c59e53e126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:04.573586 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f8fa1-da2f-44f6-ab0f-e5c59e53e126 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.579167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e64d1a-8d92-410d-9a4e-3b33db494e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.580068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e64d1a-8d92-410d-9a4e-3b33db494e35 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.581962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e64d1a-8d92-410d-9a4e-3b33db494e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.581962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e64d1a-8d92-410d-9a4e-3b33db494e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.592799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e64d1a-8d92-410d-9a4e-3b33db494e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.594259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e64d1a-8d92-410d-9a4e-3b33db494e35 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.609944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1016/2030] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:05.252883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9654d-c738-4cf9-b4cd-f84077c9f195 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.253434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9654d-c738-4cf9-b4cd-f84077c9f195 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.253907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9654d-c738-4cf9-b4cd-f84077c9f195 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.260324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1015/2031] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:26:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:26:05.265150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cabe2-762b-4d2a-8ae4-082528607a21 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.266210 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cabe2-762b-4d2a-8ae4-082528607a21 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.266577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cabe2-762b-4d2a-8ae4-082528607a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.287109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-240cabe2-762b-4d2a-8ae4-082528607a21 None None] MFA Rules not processed for user `7dde39c6d85446a681dea24573f0d6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:05.288715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-240cabe2-762b-4d2a-8ae4-082528607a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:05.333387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3f3fa-6128-4b83-b3ac-9fb694bbd32b None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.334039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3f3fa-6128-4b83-b3ac-9fb694bbd32b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.334764 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3f3fa-6128-4b83-b3ac-9fb694bbd32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.376353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-8af3f3fa-6128-4b83-b3ac-9fb694bbd32b None None] MFA Rules not processed for user `46d57f08982847ff9771802e3cbd4297`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:05.377780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8af3f3fa-6128-4b83-b3ac-9fb694bbd32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:05.407250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1017/2032] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:26:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:05.408193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cabe2-762b-4d2a-8ae4-082528607a21 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:05.409560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-240cabe2-762b-4d2a-8ae4-082528607a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:05.437201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:05.442679 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cabe2-762b-4d2a-8ae4-082528607a21 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.450534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.451913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.452429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.453007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] PATH_INFO: `/v3/users/49c56e649fb14a3caf3f2257f6023de1` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.455150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c56e649fb14a3caf3f2257f6023de1)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:05.459358 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:05.533736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1016/2033] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:05.534602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3f3fa-6128-4b83-b3ac-9fb694bbd32b None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:05.535927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8af3f3fa-6128-4b83-b3ac-9fb694bbd32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:05.560427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c56e649fb14a3caf3f2257f6023de1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:05.561149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c56e649fb14a3caf3f2257f6023de1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:05.563412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3f3fa-6128-4b83-b3ac-9fb694bbd32b None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.569047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36468-b677-4dcd-8d9d-efe30f1607ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dde39c6d85446a681dea24573f0d6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.569791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36468-b677-4dcd-8d9d-efe30f1607ab service placement] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.570767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36468-b677-4dcd-8d9d-efe30f1607ab service placement] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.570984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36468-b677-4dcd-8d9d-efe30f1607ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.582896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c56e649fb14a3caf3f2257f6023de1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:05.583096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd36468-b677-4dcd-8d9d-efe30f1607ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:05.583680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c56e649fb14a3caf3f2257f6023de1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:05.584877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd36468-b677-4dcd-8d9d-efe30f1607ab service placement] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:05.594161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c56e649fb14a3caf3f2257f6023de1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:05.597579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1017/2034] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:05.598513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36468-b677-4dcd-8d9d-efe30f1607ab service placement] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:05.600161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-1dd36468-b677-4dcd-8d9d-efe30f1607ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:05.612796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1018/2035] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:05 2022] DELETE /identity/v3/users/49c56e649fb14a3caf3f2257f6023de1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:05.716636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd36468-b677-4dcd-8d9d-efe30f1607ab service placement] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.787204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a918e-1e38-4268-b5fa-847ad00d3af2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.788624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a918e-1e38-4268-b5fa-847ad00d3af2 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.788624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a918e-1e38-4268-b5fa-847ad00d3af2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.788624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a918e-1e38-4268-b5fa-847ad00d3af2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.791132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9c6a918e-1e38-4268-b5fa-847ad00d3af2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:05.833150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:05.834603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:05.845484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:05.874573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a918e-1e38-4268-b5fa-847ad00d3af2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:05.877232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a918e-1e38-4268-b5fa-847ad00d3af2 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:05.888931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1018/2036] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:05.941915 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cc0dc-55d0-457d-84f0-db04933013c0 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.957448 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.958416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.958778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.960106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] PATH_INFO: `/v3/projects/74b68f1457ba42538df8576c0a0e85ed` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.970281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b68f1457ba42538df8576c0a0e85ed)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:05.974153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.061950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b68f1457ba42538df8576c0a0e85ed', 'request_id': 'req-9c0bd937-27a3-4f12-8448-704346e02023'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:06.074900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b68f1457ba42538df8576c0a0e85ed', 'request_id': 'req-9c0bd937-27a3-4f12-8448-704346e02023'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:06.083542 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b68f1457ba42538df8576c0a0e85ed', 'request_id': 'req-9c0bd937-27a3-4f12-8448-704346e02023'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:06.099780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] The token cache is being invalidate because project 74b68f1457ba42538df8576c0a0e85ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:06.100228 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:06.101018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9c0bd937-27a3-4f12-8448-704346e02023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:06.108873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1019/2037] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:05 2022] DELETE /identity/v3/projects/74b68f1457ba42538df8576c0a0e85ed => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:06.110725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76509900-2f84-410c-88b0-c287d8285a7a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.111027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76509900-2f84-410c-88b0-c287d8285a7a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.111317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76509900-2f84-410c-88b0-c287d8285a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.135394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-76509900-2f84-410c-88b0-c287d8285a7a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:06.137719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-76509900-2f84-410c-88b0-c287d8285a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:06.228010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1019/2038] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:06.239956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98529527-b0ea-4216-856d-9bd1d8d2c8d2 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.240276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98529527-b0ea-4216-856d-9bd1d8d2c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.240561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98529527-b0ea-4216-856d-9bd1d8d2c8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.256778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:06.264100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-98529527-b0ea-4216-856d-9bd1d8d2c8d2 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:06.266873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-98529527-b0ea-4216-856d-9bd1d8d2c8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:06.280507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1020/2039] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:06.288414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76509900-2f84-410c-88b0-c287d8285a7a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.301569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76509900-2f84-410c-88b0-c287d8285a7a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.313872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6369e95-6e65-4c4c-8018-708facb3d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.314714 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6369e95-6e65-4c4c-8018-708facb3d314 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.315363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6369e95-6e65-4c4c-8018-708facb3d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.315820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6369e95-6e65-4c4c-8018-708facb3d314 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.317648 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6369e95-6e65-4c4c-8018-708facb3d314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:06.318281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6369e95-6e65-4c4c-8018-708facb3d314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.320266 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6369e95-6e65-4c4c-8018-708facb3d314 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.335054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1020/2040] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:06.345635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98529527-b0ea-4216-856d-9bd1d8d2c8d2 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.348977 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98529527-b0ea-4216-856d-9bd1d8d2c8d2 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.353798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a26a9-0f6d-4755-991d-9ad9acca5082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.354653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a26a9-0f6d-4755-991d-9ad9acca5082 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.355090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a26a9-0f6d-4755-991d-9ad9acca5082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.355567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a26a9-0f6d-4755-991d-9ad9acca5082 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.356335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a26a9-0f6d-4755-991d-9ad9acca5082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.358254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a26a9-0f6d-4755-991d-9ad9acca5082 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.395216 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1021/2041] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:06 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:06.396380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6369e95-6e65-4c4c-8018-708facb3d314 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.406471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6369e95-6e65-4c4c-8018-708facb3d314 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.466656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545586af-fb18-4fb5-96e3-e377b5f1394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.467343 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545586af-fb18-4fb5-96e3-e377b5f1394b admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.468018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545586af-fb18-4fb5-96e3-e377b5f1394b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.468249 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545586af-fb18-4fb5-96e3-e377b5f1394b admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.468982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545586af-fb18-4fb5-96e3-e377b5f1394b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.470954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545586af-fb18-4fb5-96e3-e377b5f1394b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.491777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1021/2042] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:06 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:06.496409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a26a9-0f6d-4755-991d-9ad9acca5082 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.506544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a26a9-0f6d-4755-991d-9ad9acca5082 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.511942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138d8bb-f818-4851-8596-43fc38e01322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.512624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d8bb-f818-4851-8596-43fc38e01322 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.512906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d8bb-f818-4851-8596-43fc38e01322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.513213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d8bb-f818-4851-8596-43fc38e01322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.514058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138d8bb-f818-4851-8596-43fc38e01322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.515649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138d8bb-f818-4851-8596-43fc38e01322 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.527295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1022/2043] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:06.531317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545586af-fb18-4fb5-96e3-e377b5f1394b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.541328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545586af-fb18-4fb5-96e3-e377b5f1394b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.547018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc4ac3-dfe3-44b1-9a6b-b1cc85e87cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.547688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc4ac3-dfe3-44b1-9a6b-b1cc85e87cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.547995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc4ac3-dfe3-44b1-9a6b-b1cc85e87cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.548691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc4ac3-dfe3-44b1-9a6b-b1cc85e87cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.549472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc4ac3-dfe3-44b1-9a6b-b1cc85e87cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.551107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc4ac3-dfe3-44b1-9a6b-b1cc85e87cc5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.563738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1022/2044] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:06.567870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138d8bb-f818-4851-8596-43fc38e01322 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.579416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138d8bb-f818-4851-8596-43fc38e01322 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.585337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a7895-a11b-4c72-b073-fae6046017c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.586571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a7895-a11b-4c72-b073-fae6046017c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.586983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a7895-a11b-4c72-b073-fae6046017c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.587345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a7895-a11b-4c72-b073-fae6046017c8 admin admin] PATH_INFO: `/v3/projects/23023fc71f514b6c874ec51e36baae0d/users/a8410b7d0fb5439093612945f24f4c60/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.603774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a7895-a11b-4c72-b073-fae6046017c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23023fc71f514b6c874ec51e36baae0d, user_id=a8410b7d0fb5439093612945f24f4c60, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.606568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a7895-a11b-4c72-b073-fae6046017c8 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.620239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1023/2045] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:06 2022] PUT /identity/v3/projects/23023fc71f514b6c874ec51e36baae0d/users/a8410b7d0fb5439093612945f24f4c60/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:06.630543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63b8a5-e952-41ca-9147-c97af7634baa None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.630829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63b8a5-e952-41ca-9147-c97af7634baa None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.631107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63b8a5-e952-41ca-9147-c97af7634baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.661719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ae63b8a5-e952-41ca-9147-c97af7634baa None None] MFA Rules not processed for user `a8410b7d0fb5439093612945f24f4c60`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:06.661719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ae63b8a5-e952-41ca-9147-c97af7634baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:06.696673 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:06.730303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1023/2046] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:06.734814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a7895-a11b-4c72-b073-fae6046017c8 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.795350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a7895-a11b-4c72-b073-fae6046017c8 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.799978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a302bf9-32b9-4fa1-8c9a-d7f4ad61ad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.800714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a302bf9-32b9-4fa1-8c9a-d7f4ad61ad23 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.801001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a302bf9-32b9-4fa1-8c9a-d7f4ad61ad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.801280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a302bf9-32b9-4fa1-8c9a-d7f4ad61ad23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.801972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a302bf9-32b9-4fa1-8c9a-d7f4ad61ad23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.803895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a302bf9-32b9-4fa1-8c9a-d7f4ad61ad23 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.829009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1024/2047] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:06 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:06.833234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63b8a5-e952-41ca-9147-c97af7634baa None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.844562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63b8a5-e952-41ca-9147-c97af7634baa None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.901914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e6d4f-f9c6-4bce-b4ad-aa0465c52ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.902570 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e6d4f-f9c6-4bce-b4ad-aa0465c52ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.902855 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e6d4f-f9c6-4bce-b4ad-aa0465c52ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.903129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e6d4f-f9c6-4bce-b4ad-aa0465c52ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.903824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e6d4f-f9c6-4bce-b4ad-aa0465c52ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.905787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e6d4f-f9c6-4bce-b4ad-aa0465c52ea1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.924613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1024/2048] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:06 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:06.928587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a302bf9-32b9-4fa1-8c9a-d7f4ad61ad23 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.938907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a302bf9-32b9-4fa1-8c9a-d7f4ad61ad23 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.943469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c2b86-902b-4b79-89d1-bc593b41d6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.944168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2b86-902b-4b79-89d1-bc593b41d6ac admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.944457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2b86-902b-4b79-89d1-bc593b41d6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.944742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2b86-902b-4b79-89d1-bc593b41d6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.945465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c2b86-902b-4b79-89d1-bc593b41d6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.947592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c2b86-902b-4b79-89d1-bc593b41d6ac admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.958245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1025/2049] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:06.962069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e6d4f-f9c6-4bce-b4ad-aa0465c52ea1 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.972308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e6d4f-f9c6-4bce-b4ad-aa0465c52ea1 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.976843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb7589-febc-4589-a2b6-c12d9c09a0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.977706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb7589-febc-4589-a2b6-c12d9c09a0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.977991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb7589-febc-4589-a2b6-c12d9c09a0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.978272 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb7589-febc-4589-a2b6-c12d9c09a0ee admin admin] PATH_INFO: `/v3/projects/bd84016ad3ba417587e8bb181f366c20/users/0c389d13434147b187c5c7281d7eb76f/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.993279 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb7589-febc-4589-a2b6-c12d9c09a0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd84016ad3ba417587e8bb181f366c20, user_id=0c389d13434147b187c5c7281d7eb76f, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.995934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb7589-febc-4589-a2b6-c12d9c09a0ee admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:07.008379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1025/2050] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:06 2022] PUT /identity/v3/projects/bd84016ad3ba417587e8bb181f366c20/users/0c389d13434147b187c5c7281d7eb76f/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:07.012610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c2b86-902b-4b79-89d1-bc593b41d6ac admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:07.023409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c2b86-902b-4b79-89d1-bc593b41d6ac admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:07.081429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd872840-d3b5-4ff6-8b79-3a3d0a8e757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:07.082161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd872840-d3b5-4ff6-8b79-3a3d0a8e757c admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:07.082451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd872840-d3b5-4ff6-8b79-3a3d0a8e757c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:07.082726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd872840-d3b5-4ff6-8b79-3a3d0a8e757c admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:07.083448 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd872840-d3b5-4ff6-8b79-3a3d0a8e757c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:07.085094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd872840-d3b5-4ff6-8b79-3a3d0a8e757c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:07.096074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1026/2051] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:07.100313 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb7589-febc-4589-a2b6-c12d9c09a0ee admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:07.113098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb7589-febc-4589-a2b6-c12d9c09a0ee admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:07.118071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d39f9-631e-429c-b14a-edee161c67b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:07.119492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d39f9-631e-429c-b14a-edee161c67b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:07.119792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d39f9-631e-429c-b14a-edee161c67b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:07.120089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d39f9-631e-429c-b14a-edee161c67b4 admin admin] PATH_INFO: `/v3/projects/bd84016ad3ba417587e8bb181f366c20/users/0c389d13434147b187c5c7281d7eb76f/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:07.122307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d39f9-631e-429c-b14a-edee161c67b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd84016ad3ba417587e8bb181f366c20, user_id=0c389d13434147b187c5c7281d7eb76f, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:07.125069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d39f9-631e-429c-b14a-edee161c67b4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:07.135827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1026/2052] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:07 2022] PUT /identity/v3/projects/bd84016ad3ba417587e8bb181f366c20/users/0c389d13434147b187c5c7281d7eb76f/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:07.146832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e9f7-739b-4d32-a864-d72e80c11fc4 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:07.147129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e9f7-739b-4d32-a864-d72e80c11fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:07.147416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416e9f7-739b-4d32-a864-d72e80c11fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:07.173569 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:07.177299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c416e9f7-739b-4d32-a864-d72e80c11fc4 None None] MFA Rules not processed for user `0c389d13434147b187c5c7281d7eb76f`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:07.179295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c416e9f7-739b-4d32-a864-d72e80c11fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:07.267947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1027/2053] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:07.280158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d39f9-631e-429c-b14a-edee161c67b4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:07.282303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b68d39f9-631e-429c-b14a-edee161c67b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:07.340621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d39f9-631e-429c-b14a-edee161c67b4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:07.344391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563cb3a-68e1-431d-bcbc-45a8b4d54824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:07.345044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563cb3a-68e1-431d-bcbc-45a8b4d54824 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:07.345333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563cb3a-68e1-431d-bcbc-45a8b4d54824 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:07.345612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563cb3a-68e1-431d-bcbc-45a8b4d54824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:07.355289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563cb3a-68e1-431d-bcbc-45a8b4d54824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:07.357067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563cb3a-68e1-431d-bcbc-45a8b4d54824 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:07.366939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1027/2054] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:07.403939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cc8df-70b6-44ce-80c8-de96496d5767 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:07.404311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cc8df-70b6-44ce-80c8-de96496d5767 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:07.404594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cc8df-70b6-44ce-80c8-de96496d5767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:07.423469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-fa4cc8df-70b6-44ce-80c8-de96496d5767 None None] MFA Rules not processed for user `46d57f08982847ff9771802e3cbd4297`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:07.425149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fa4cc8df-70b6-44ce-80c8-de96496d5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:07.494828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1028/2055] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:07.782193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563cb3a-68e1-431d-bcbc-45a8b4d54824 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:07.828319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:07.861181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563cb3a-68e1-431d-bcbc-45a8b4d54824 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:07.866120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:07.866994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:07.867279 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:07.867829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] PATH_INFO: `/v3/users/a8410b7d0fb5439093612945f24f4c60` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:07.869563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8410b7d0fb5439093612945f24f4c60)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:07.872010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:07.921787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8410b7d0fb5439093612945f24f4c60'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:07.935114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8410b7d0fb5439093612945f24f4c60'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:07.935864 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8410b7d0fb5439093612945f24f4c60'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:07.943455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8410b7d0fb5439093612945f24f4c60'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:07.951204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8410b7d0fb5439093612945f24f4c60'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:07.957264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1028/2056] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:07 2022] DELETE /identity/v3/users/a8410b7d0fb5439093612945f24f4c60 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:07.961857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc00b8-218e-4029-9807-ae5b89861f53 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:07.962257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc00b8-218e-4029-9807-ae5b89861f53 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:07.963595 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc00b8-218e-4029-9807-ae5b89861f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:07.986916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-fbdc00b8-218e-4029-9807-ae5b89861f53 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:07.988156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fbdc00b8-218e-4029-9807-ae5b89861f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:08.061065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1029/2057] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:08.070571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:08.072132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:08.141619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b6a9-eac5-4b11-b127-85a98d792893 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:08.145297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4033af-5c16-43da-ba38-94a131925fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:08.145945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4033af-5c16-43da-ba38-94a131925fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:08.146228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4033af-5c16-43da-ba38-94a131925fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:08.146502 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4033af-5c16-43da-ba38-94a131925fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:08.156172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4033af-5c16-43da-ba38-94a131925fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:08.157603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4033af-5c16-43da-ba38-94a131925fa9 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:08.167629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1029/2058] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:08.492612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc00b8-218e-4029-9807-ae5b89861f53 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:08.495934 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fbdc00b8-218e-4029-9807-ae5b89861f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:08.524124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc00b8-218e-4029-9807-ae5b89861f53 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:08.531939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:08.533385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:08.533850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:08.534142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] PATH_INFO: `/v3/projects/23023fc71f514b6c874ec51e36baae0d` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:08.535758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23023fc71f514b6c874ec51e36baae0d)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:08.538046 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:08.589274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:08.601508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23023fc71f514b6c874ec51e36baae0d', 'request_id': 'req-18e48a75-3077-4f30-bfab-6aed39e4a993'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.610420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23023fc71f514b6c874ec51e36baae0d', 'request_id': 'req-18e48a75-3077-4f30-bfab-6aed39e4a993'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.617112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23023fc71f514b6c874ec51e36baae0d', 'request_id': 'req-18e48a75-3077-4f30-bfab-6aed39e4a993'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.629310 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] The token cache is being invalidate because project 23023fc71f514b6c874ec51e36baae0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:08.629598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.630246 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.635482 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1030/2059] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:08 2022] DELETE /identity/v3/projects/23023fc71f514b6c874ec51e36baae0d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:08.636706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4033af-5c16-43da-ba38-94a131925fa9 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:08.646387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4033af-5c16-43da-ba38-94a131925fa9 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:08.697475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:08.708083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa50d3-86cb-40ed-bd92-6e381cdb8436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:08.709001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa50d3-86cb-40ed-bd92-6e381cdb8436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:08.709263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa50d3-86cb-40ed-bd92-6e381cdb8436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:08.709548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa50d3-86cb-40ed-bd92-6e381cdb8436 admin admin] PATH_INFO: `/v3/users/0c389d13434147b187c5c7281d7eb76f` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:08.710777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa50d3-86cb-40ed-bd92-6e381cdb8436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c389d13434147b187c5c7281d7eb76f)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:08.712894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa50d3-86cb-40ed-bd92-6e381cdb8436 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:08.763552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-99aa50d3-86cb-40ed-bd92-6e381cdb8436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c389d13434147b187c5c7281d7eb76f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.777293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-99aa50d3-86cb-40ed-bd92-6e381cdb8436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c389d13434147b187c5c7281d7eb76f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.778627 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-99aa50d3-86cb-40ed-bd92-6e381cdb8436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c389d13434147b187c5c7281d7eb76f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.785847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-99aa50d3-86cb-40ed-bd92-6e381cdb8436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c389d13434147b187c5c7281d7eb76f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.793026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-99aa50d3-86cb-40ed-bd92-6e381cdb8436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c389d13434147b187c5c7281d7eb76f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.798921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1030/2060] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:08 2022] DELETE /identity/v3/users/0c389d13434147b187c5c7281d7eb76f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:08.846421 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:08.848253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:08.862179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e48a75-3077-4f30-bfab-6aed39e4a993 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:08.923750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:08.924678 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:08.924965 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:08.925245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] PATH_INFO: `/v3/users/bfc2bb5edbbd4337a1c91ace5c2ec865` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:08.926453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc2bb5edbbd4337a1c91ace5c2ec865)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:08.928502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:08.979409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc2bb5edbbd4337a1c91ace5c2ec865'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.980160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc2bb5edbbd4337a1c91ace5c2ec865'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.992893 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc2bb5edbbd4337a1c91ace5c2ec865'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:08.994373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc2bb5edbbd4337a1c91ace5c2ec865'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.002005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc2bb5edbbd4337a1c91ace5c2ec865'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.016053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1031/2061] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:08 2022] DELETE /identity/v3/users/bfc2bb5edbbd4337a1c91ace5c2ec865 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:09.020587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6784-c553-4019-be0e-6eedbada1999 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.021000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6784-c553-4019-be0e-6eedbada1999 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.021383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6784-c553-4019-be0e-6eedbada1999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.040084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-16ff6784-c553-4019-be0e-6eedbada1999 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:09.041890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-16ff6784-c553-4019-be0e-6eedbada1999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:09.095057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:09.097024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:09.117806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1031/2062] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:09.133037 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff6784-c553-4019-be0e-6eedbada1999 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:09.135888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-16ff6784-c553-4019-be0e-6eedbada1999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:09.162595 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:09.187441 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0d84f-e162-43ad-9004-a570448eea1b admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:09.192499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:09.193492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.193993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.194377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] PATH_INFO: `/v3/projects/bd84016ad3ba417587e8bb181f366c20` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.195887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd84016ad3ba417587e8bb181f366c20)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:09.199537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:09.215774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff6784-c553-4019-be0e-6eedbada1999 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:09.222925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6233181-95e8-4e15-aad4-2ab6bf1358ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:09.223599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233181-95e8-4e15-aad4-2ab6bf1358ac service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.223885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233181-95e8-4e15-aad4-2ab6bf1358ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.224353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233181-95e8-4e15-aad4-2ab6bf1358ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.236192 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6233181-95e8-4e15-aad4-2ab6bf1358ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:09.237925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6233181-95e8-4e15-aad4-2ab6bf1358ac service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:09.250911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1032/2063] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:09.278057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd84016ad3ba417587e8bb181f366c20', 'request_id': 'req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.288473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd84016ad3ba417587e8bb181f366c20', 'request_id': 'req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.294879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd84016ad3ba417587e8bb181f366c20', 'request_id': 'req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.306913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] The token cache is being invalidate because project bd84016ad3ba417587e8bb181f366c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:09.307204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.307944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-a4520ff1-6c1b-4119-bc1f-cda87bcdda95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.309897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1032/2064] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:09 2022] DELETE /identity/v3/projects/bd84016ad3ba417587e8bb181f366c20 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:09.314997 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0c349-76b4-4d68-bba2-f532f9ab9d0a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.315299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0c349-76b4-4d68-bba2-f532f9ab9d0a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.315579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0c349-76b4-4d68-bba2-f532f9ab9d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.338217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-8fa0c349-76b4-4d68-bba2-f532f9ab9d0a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:09.339380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8fa0c349-76b4-4d68-bba2-f532f9ab9d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:09.352634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:09.416903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1033/2065] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:09.424885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f54d0c-6ce5-49a1-afad-ab5fd6a97f07 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.425184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f54d0c-6ce5-49a1-afad-ab5fd6a97f07 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.425474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f54d0c-6ce5-49a1-afad-ab5fd6a97f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.444733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-28f54d0c-6ce5-49a1-afad-ab5fd6a97f07 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:09.446365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-28f54d0c-6ce5-49a1-afad-ab5fd6a97f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:09.455366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1033/2066] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:09.459662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0c349-76b4-4d68-bba2-f532f9ab9d0a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:09.470335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0c349-76b4-4d68-bba2-f532f9ab9d0a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:09.475622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b6bfb-26d6-46fe-ac26-2e75a7b167b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:09.476484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6bfb-26d6-46fe-ac26-2e75a7b167b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.476604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6bfb-26d6-46fe-ac26-2e75a7b167b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.476869 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b6bfb-26d6-46fe-ac26-2e75a7b167b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.477601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b6bfb-26d6-46fe-ac26-2e75a7b167b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:09.477945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b6bfb-26d6-46fe-ac26-2e75a7b167b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:09.479604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b6bfb-26d6-46fe-ac26-2e75a7b167b9 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:09.492475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1034/2067] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:09.497432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f54d0c-6ce5-49a1-afad-ab5fd6a97f07 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:09.507641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f54d0c-6ce5-49a1-afad-ab5fd6a97f07 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:09.513507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714fec5-23b1-4923-a444-124bfed86cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:09.514176 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714fec5-23b1-4923-a444-124bfed86cde admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.514464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714fec5-23b1-4923-a444-124bfed86cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.514742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714fec5-23b1-4923-a444-124bfed86cde admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.515432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714fec5-23b1-4923-a444-124bfed86cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:09.517512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714fec5-23b1-4923-a444-124bfed86cde admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:09.549408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1034/2068] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:09 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:09.553466 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b6bfb-26d6-46fe-ac26-2e75a7b167b9 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:09.580374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b6bfb-26d6-46fe-ac26-2e75a7b167b9 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:09.654954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc9fba-7189-44e2-9638-eed4c582f066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:09.655697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc9fba-7189-44e2-9638-eed4c582f066 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.656144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc9fba-7189-44e2-9638-eed4c582f066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.656531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc9fba-7189-44e2-9638-eed4c582f066 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.657334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc9fba-7189-44e2-9638-eed4c582f066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:09.659520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc9fba-7189-44e2-9638-eed4c582f066 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:09.683936 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1035/2069] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:09 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:09.687763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714fec5-23b1-4923-a444-124bfed86cde admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:09.689055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc9fba-7189-44e2-9638-eed4c582f066 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:09.690789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4ebc9fba-7189-44e2-9638-eed4c582f066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:09.705170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc9fba-7189-44e2-9638-eed4c582f066 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:09.710911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183badb-a9bd-48bb-9b5e-b88092030b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:09.711920 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183badb-a9bd-48bb-9b5e-b88092030b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.712262 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183badb-a9bd-48bb-9b5e-b88092030b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.712557 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183badb-a9bd-48bb-9b5e-b88092030b04 admin admin] PATH_INFO: `/v3/users/a2b33070778c40259af1abf7021f3be1` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.713889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183badb-a9bd-48bb-9b5e-b88092030b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b33070778c40259af1abf7021f3be1)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:09.716227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183badb-a9bd-48bb-9b5e-b88092030b04 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:09.716388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714fec5-23b1-4923-a444-124bfed86cde admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:09.733466 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a632f-691d-4d7b-88be-5abebab91c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:09.734170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a632f-691d-4d7b-88be-5abebab91c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.734459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a632f-691d-4d7b-88be-5abebab91c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.734743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a632f-691d-4d7b-88be-5abebab91c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.735486 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a632f-691d-4d7b-88be-5abebab91c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:09.737139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a632f-691d-4d7b-88be-5abebab91c4f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:09.750173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1035/2070] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:09.754007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a632f-691d-4d7b-88be-5abebab91c4f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:09.765775 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a632f-691d-4d7b-88be-5abebab91c4f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:09.771625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d7e5b-55cc-450f-af03-520a03111c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:09.772341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d7e5b-55cc-450f-af03-520a03111c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.772631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d7e5b-55cc-450f-af03-520a03111c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.773509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d7e5b-55cc-450f-af03-520a03111c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.774256 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d7e5b-55cc-450f-af03-520a03111c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:09.776286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d7e5b-55cc-450f-af03-520a03111c81 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:09.785973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2183badb-a9bd-48bb-9b5e-b88092030b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b33070778c40259af1abf7021f3be1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.788565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1036/2071] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:09.793903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d7e5b-55cc-450f-af03-520a03111c81 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:09.805056 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d7e5b-55cc-450f-af03-520a03111c81 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:09.805350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2183badb-a9bd-48bb-9b5e-b88092030b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b33070778c40259af1abf7021f3be1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.807249 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2183badb-a9bd-48bb-9b5e-b88092030b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b33070778c40259af1abf7021f3be1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.811022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a67809-f13c-4c16-867d-48add7b917e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:09.812172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a67809-f13c-4c16-867d-48add7b917e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.812531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a67809-f13c-4c16-867d-48add7b917e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.812884 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a67809-f13c-4c16-867d-48add7b917e0 admin admin] PATH_INFO: `/v3/projects/0abfbc318a934bc78917f631c4fed8a9/users/164fc427d381465ba8dde428eb7513fc/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.820377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2183badb-a9bd-48bb-9b5e-b88092030b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b33070778c40259af1abf7021f3be1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.831077 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a67809-f13c-4c16-867d-48add7b917e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abfbc318a934bc78917f631c4fed8a9, user_id=164fc427d381465ba8dde428eb7513fc, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:09.834311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a67809-f13c-4c16-867d-48add7b917e0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:09.837846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2183badb-a9bd-48bb-9b5e-b88092030b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b33070778c40259af1abf7021f3be1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:09.854482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1036/2072] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:09 2022] DELETE /identity/v3/users/a2b33070778c40259af1abf7021f3be1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:09.864586 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1037/2073] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:09 2022] PUT /identity/v3/projects/0abfbc318a934bc78917f631c4fed8a9/users/164fc427d381465ba8dde428eb7513fc/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:09.864786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ef9f0-5dfb-446c-975f-f888c0a300d8 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.864786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ef9f0-5dfb-446c-975f-f888c0a300d8 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.864786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ef9f0-5dfb-446c-975f-f888c0a300d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.865955 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cae6a4-8a1c-459f-a457-785ed06d00f3 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:09.866350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cae6a4-8a1c-459f-a457-785ed06d00f3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:09.866654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cae6a4-8a1c-459f-a457-785ed06d00f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:09.876616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:09.897523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4e4ef9f0-5dfb-446c-975f-f888c0a300d8 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:09.898778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4e4ef9f0-5dfb-446c-975f-f888c0a300d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:09.899462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-95cae6a4-8a1c-459f-a457-785ed06d00f3 None None] MFA Rules not processed for user `164fc427d381465ba8dde428eb7513fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:09.900716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-95cae6a4-8a1c-459f-a457-785ed06d00f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:09.959306 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:09.992117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1038/2074] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:09.993141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1037/2075] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:09.995373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cae6a4-8a1c-459f-a457-785ed06d00f3 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:09.997841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ef9f0-5dfb-446c-975f-f888c0a300d8 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:09.999604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4e4ef9f0-5dfb-446c-975f-f888c0a300d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:09.999920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-95cae6a4-8a1c-459f-a457-785ed06d00f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:10.012865 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ef9f0-5dfb-446c-975f-f888c0a300d8 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.018613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a28b62-61dd-49a4-a575-de977d24e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.019435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a28b62-61dd-49a4-a575-de977d24e017 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.019797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a28b62-61dd-49a4-a575-de977d24e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.020135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a28b62-61dd-49a4-a575-de977d24e017 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.021563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a28b62-61dd-49a4-a575-de977d24e017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.022769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a28b62-61dd-49a4-a575-de977d24e017 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.025793 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cae6a4-8a1c-459f-a457-785ed06d00f3 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.033288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.035051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.035685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.036150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] PATH_INFO: `/v3/projects/ffbba4e2c1b94d6e95f53f7a8238ac5c` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.037826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffbba4e2c1b94d6e95f53f7a8238ac5c)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.041388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.054556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1038/2076] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:09 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:10.054556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a28b62-61dd-49a4-a575-de977d24e017 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.056714 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-84a28b62-61dd-49a4-a575-de977d24e017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:10.098712 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffbba4e2c1b94d6e95f53f7a8238ac5c', 'request_id': 'req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:10.109160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffbba4e2c1b94d6e95f53f7a8238ac5c', 'request_id': 'req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:10.116467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffbba4e2c1b94d6e95f53f7a8238ac5c', 'request_id': 'req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:10.127376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a28b62-61dd-49a4-a575-de977d24e017 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.133272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] The token cache is being invalidate because project ffbba4e2c1b94d6e95f53f7a8238ac5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:10.133570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:10.134298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:10.139149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1039/2077] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:09 2022] DELETE /identity/v3/projects/ffbba4e2c1b94d6e95f53f7a8238ac5c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:10.139149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.139149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:10.199582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40e44a-9530-4873-a2bb-e2f0f7994dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.200327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40e44a-9530-4873-a2bb-e2f0f7994dac service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.200614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40e44a-9530-4873-a2bb-e2f0f7994dac service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.201537 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40e44a-9530-4873-a2bb-e2f0f7994dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.203632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2a40e44a-9530-4873-a2bb-e2f0f7994dac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:10.219739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365dc83-61cc-4f6b-bf26-96e37e5f1b5c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.225532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbeb200-f653-478c-8fee-b3259130b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.226326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeb200-f653-478c-8fee-b3259130b7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.226674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeb200-f653-478c-8fee-b3259130b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.227013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbeb200-f653-478c-8fee-b3259130b7c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.227992 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbeb200-f653-478c-8fee-b3259130b7c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.230874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbeb200-f653-478c-8fee-b3259130b7c0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.257519 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1040/2078] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:10 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:10.258969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d9fd-f39f-4e42-8562-714dd5323d7e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.259305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d9fd-f39f-4e42-8562-714dd5323d7e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.259591 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d9fd-f39f-4e42-8562-714dd5323d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.266304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:10.281930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-9261d9fd-f39f-4e42-8562-714dd5323d7e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:10.282132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40e44a-9530-4873-a2bb-e2f0f7994dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.282254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9261d9fd-f39f-4e42-8562-714dd5323d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:10.283152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40e44a-9530-4873-a2bb-e2f0f7994dac service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.293671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1041/2079] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:10.294345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261d9fd-f39f-4e42-8562-714dd5323d7e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.299070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1039/2080] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:10.305672 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf12c1-ee12-43f3-85b9-3fe914db6edc None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.308384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf12c1-ee12-43f3-85b9-3fe914db6edc None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.308803 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf12c1-ee12-43f3-85b9-3fe914db6edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.314552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261d9fd-f39f-4e42-8562-714dd5323d7e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.335170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0cc3b-8bd8-46e0-ba2b-a252304e0512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.336038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0cc3b-8bd8-46e0-ba2b-a252304e0512 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.337018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0cc3b-8bd8-46e0-ba2b-a252304e0512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.337452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0cc3b-8bd8-46e0-ba2b-a252304e0512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.338435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0cc3b-8bd8-46e0-ba2b-a252304e0512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.340471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0cc3b-8bd8-46e0-ba2b-a252304e0512 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.343599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-fbcf12c1-ee12-43f3-85b9-3fe914db6edc None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:10.345029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-fbcf12c1-ee12-43f3-85b9-3fe914db6edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:10.354412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1042/2081] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:10.358478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0cc3b-8bd8-46e0-ba2b-a252304e0512 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.359602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1040/2082] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:10.364608 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf12c1-ee12-43f3-85b9-3fe914db6edc None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.377167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0cc3b-8bd8-46e0-ba2b-a252304e0512 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.377447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf12c1-ee12-43f3-85b9-3fe914db6edc None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.382995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56542a6b-5a7d-4a14-a734-32bc16e6ec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.384100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56542a6b-5a7d-4a14-a734-32bc16e6ec97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.385147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56542a6b-5a7d-4a14-a734-32bc16e6ec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.385513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56542a6b-5a7d-4a14-a734-32bc16e6ec97 admin admin] PATH_INFO: `/v3/projects/fc763117a2464796a14d71bba780bcf7/users/81f60ed46b294fda864be22e8515e5f0/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.386228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ee64f-1721-4fdf-900c-1606fa2d829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.386905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ee64f-1721-4fdf-900c-1606fa2d829f admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.387247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ee64f-1721-4fdf-900c-1606fa2d829f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.387535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ee64f-1721-4fdf-900c-1606fa2d829f admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.388458 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ee64f-1721-4fdf-900c-1606fa2d829f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:10.388781 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ee64f-1721-4fdf-900c-1606fa2d829f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.391114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ee64f-1721-4fdf-900c-1606fa2d829f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.404700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56542a6b-5a7d-4a14-a734-32bc16e6ec97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc763117a2464796a14d71bba780bcf7, user_id=81f60ed46b294fda864be22e8515e5f0, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.406273 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1041/2083] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:26:10.407790 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56542a6b-5a7d-4a14-a734-32bc16e6ec97 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.411755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ee64f-1721-4fdf-900c-1606fa2d829f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.423854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1043/2084] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:10 2022] PUT /identity/v3/projects/fc763117a2464796a14d71bba780bcf7/users/81f60ed46b294fda864be22e8515e5f0/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:10.429432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ee64f-1721-4fdf-900c-1606fa2d829f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.430818 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56542a6b-5a7d-4a14-a734-32bc16e6ec97 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.460498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:10.518069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ba100-90f4-4d36-ab23-bee4a242cce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.519034 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba100-90f4-4d36-ab23-bee4a242cce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.519329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba100-90f4-4d36-ab23-bee4a242cce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.519619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ba100-90f4-4d36-ab23-bee4a242cce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.520375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ba100-90f4-4d36-ab23-bee4a242cce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.521206 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56542a6b-5a7d-4a14-a734-32bc16e6ec97 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.522530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ba100-90f4-4d36-ab23-bee4a242cce1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.526636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac14e-3828-4d76-b62a-ab922208e6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.527389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac14e-3828-4d76-b62a-ab922208e6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.527755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac14e-3828-4d76-b62a-ab922208e6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.528146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac14e-3828-4d76-b62a-ab922208e6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.528959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ac14e-3828-4d76-b62a-ab922208e6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.530929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ac14e-3828-4d76-b62a-ab922208e6c7 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.542956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1044/2085] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:10.547156 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac14e-3828-4d76-b62a-ab922208e6c7 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.559258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac14e-3828-4d76-b62a-ab922208e6c7 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.565152 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab0fb4-215b-4d81-a913-fd0d9363654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.566155 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab0fb4-215b-4d81-a913-fd0d9363654d admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.569377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab0fb4-215b-4d81-a913-fd0d9363654d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.569377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab0fb4-215b-4d81-a913-fd0d9363654d admin admin] PATH_INFO: `/v3/projects/fc763117a2464796a14d71bba780bcf7/users/81f60ed46b294fda864be22e8515e5f0/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.569613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1042/2086] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:10 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:10.569729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab0fb4-215b-4d81-a913-fd0d9363654d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc763117a2464796a14d71bba780bcf7, user_id=81f60ed46b294fda864be22e8515e5f0, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.570481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ba100-90f4-4d36-ab23-bee4a242cce1 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.572842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab0fb4-215b-4d81-a913-fd0d9363654d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.586609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1045/2087] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:10 2022] PUT /identity/v3/projects/fc763117a2464796a14d71bba780bcf7/users/81f60ed46b294fda864be22e8515e5f0/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:10.598299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c6b29-e5f9-4c58-9092-50450f5ebfa4 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.598891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c6b29-e5f9-4c58-9092-50450f5ebfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.599128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c6b29-e5f9-4c58-9092-50450f5ebfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.631746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6b9c6b29-e5f9-4c58-9092-50450f5ebfa4 None None] MFA Rules not processed for user `81f60ed46b294fda864be22e8515e5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:10.633399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6b9c6b29-e5f9-4c58-9092-50450f5ebfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:10.685877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ba100-90f4-4d36-ab23-bee4a242cce1 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.744791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1046/2088] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:10.764775 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c6b29-e5f9-4c58-9092-50450f5ebfa4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.766722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6b9c6b29-e5f9-4c58-9092-50450f5ebfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:10.778076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ea700-29a7-41f3-b1ed-40d34a5ef740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.778964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ea700-29a7-41f3-b1ed-40d34a5ef740 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.779291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ea700-29a7-41f3-b1ed-40d34a5ef740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.779766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ea700-29a7-41f3-b1ed-40d34a5ef740 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.780679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ea700-29a7-41f3-b1ed-40d34a5ef740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.783110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ea700-29a7-41f3-b1ed-40d34a5ef740 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.797805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:10.816009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1043/2089] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:10 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:10.816009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ea700-29a7-41f3-b1ed-40d34a5ef740 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.816009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d84ea700-29a7-41f3-b1ed-40d34a5ef740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:10.830031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ea700-29a7-41f3-b1ed-40d34a5ef740 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.839219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.840730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.841910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.842228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] PATH_INFO: `/v3/projects/7b22e1b72def451ea26f34c0016284ed` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.844827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b22e1b72def451ea26f34c0016284ed)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.846868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.880597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c6b29-e5f9-4c58-9092-50450f5ebfa4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.885182 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122eb44-adfe-4af4-b29f-22739e0b7dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.885844 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122eb44-adfe-4af4-b29f-22739e0b7dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.886130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122eb44-adfe-4af4-b29f-22739e0b7dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.886409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122eb44-adfe-4af4-b29f-22739e0b7dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.897952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122eb44-adfe-4af4-b29f-22739e0b7dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:10.899398 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122eb44-adfe-4af4-b29f-22739e0b7dc0 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:10.912768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1047/2090] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:10.914001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122eb44-adfe-4af4-b29f-22739e0b7dc0 service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.931983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122eb44-adfe-4af4-b29f-22739e0b7dc0 service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.934149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b22e1b72def451ea26f34c0016284ed', 'request_id': 'req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:10.948933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b22e1b72def451ea26f34c0016284ed', 'request_id': 'req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:10.960718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b22e1b72def451ea26f34c0016284ed', 'request_id': 'req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:10.985162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:11.001133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] The token cache is being invalidate because project 7b22e1b72def451ea26f34c0016284ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:11.001458 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:11.002602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:11.004539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1044/2091] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:10 2022] DELETE /identity/v3/projects/7b22e1b72def451ea26f34c0016284ed => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:11.005141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.006503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:11.066876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf7708-023e-474b-9b56-9be7fc64223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.067573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf7708-023e-474b-9b56-9be7fc64223f admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.067878 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf7708-023e-474b-9b56-9be7fc64223f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.068262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf7708-023e-474b-9b56-9be7fc64223f admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.069011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf7708-023e-474b-9b56-9be7fc64223f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.070623 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf7708-023e-474b-9b56-9be7fc64223f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.090709 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1048/2092] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:11.094769 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c0fc-a5df-4b4a-ad4e-eecde1b3941b None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.095880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c0fc-a5df-4b4a-ad4e-eecde1b3941b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.096220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c0fc-a5df-4b4a-ad4e-eecde1b3941b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.118567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4bc8c0fc-a5df-4b4a-ad4e-eecde1b3941b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:11.118997 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22786953-9ac0-4d9f-a75e-0b6153f6c6eb admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.119804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4bc8c0fc-a5df-4b4a-ad4e-eecde1b3941b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:11.122823 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4ee25-0b7f-4947-a13b-2233140fb20d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.123473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4ee25-0b7f-4947-a13b-2233140fb20d service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.123754 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4ee25-0b7f-4947-a13b-2233140fb20d service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.124063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4ee25-0b7f-4947-a13b-2233140fb20d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.125970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-22f4ee25-0b7f-4947-a13b-2233140fb20d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:11.128736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1049/2093] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:11.135759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8c0fc-a5df-4b4a-ad4e-eecde1b3941b None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.137369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4bc8c0fc-a5df-4b4a-ad4e-eecde1b3941b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:11.153018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8c0fc-a5df-4b4a-ad4e-eecde1b3941b None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.158442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd45c8-ebc1-431d-a0f6-351df1918ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.159119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd45c8-ebc1-431d-a0f6-351df1918ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.159410 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd45c8-ebc1-431d-a0f6-351df1918ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.159814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd45c8-ebc1-431d-a0f6-351df1918ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.160824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd45c8-ebc1-431d-a0f6-351df1918ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.162507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd45c8-ebc1-431d-a0f6-351df1918ee6 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.175192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1050/2094] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:11.176670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83a9aa-88aa-4d78-b1fb-84a657864258 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.176974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83a9aa-88aa-4d78-b1fb-84a657864258 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.177317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83a9aa-88aa-4d78-b1fb-84a657864258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.194186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4ee25-0b7f-4947-a13b-2233140fb20d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.195638 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4ee25-0b7f-4947-a13b-2233140fb20d service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.195772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ea83a9aa-88aa-4d78-b1fb-84a657864258 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:11.197199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ea83a9aa-88aa-4d78-b1fb-84a657864258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:11.205819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1045/2095] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:11.206073 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4ee25-0b7f-4947-a13b-2233140fb20d service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.209596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1051/2096] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:11.210607 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83a9aa-88aa-4d78-b1fb-84a657864258 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.220571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4ee25-0b7f-4947-a13b-2233140fb20d service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.221252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83a9aa-88aa-4d78-b1fb-84a657864258 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.226360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c3332-e11e-4611-b994-852586f2f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.227037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc62358-0f3c-4585-ac1c-b95401358594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.227397 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c3332-e11e-4611-b994-852586f2f671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.228522 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c3332-e11e-4611-b994-852586f2f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.228628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc62358-0f3c-4585-ac1c-b95401358594 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.228706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c3332-e11e-4611-b994-852586f2f671 admin admin] PATH_INFO: `/v3/projects/33697b80b7624060bb6abea83e75f189/users/2fb4c80b10354298ba7260573627cdf8/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.228777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc62358-0f3c-4585-ac1c-b95401358594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.228846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc62358-0f3c-4585-ac1c-b95401358594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.229624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc62358-0f3c-4585-ac1c-b95401358594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:11.229969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc62358-0f3c-4585-ac1c-b95401358594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.231573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc62358-0f3c-4585-ac1c-b95401358594 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.244137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1052/2097] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:11.246312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c3332-e11e-4611-b994-852586f2f671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33697b80b7624060bb6abea83e75f189, user_id=2fb4c80b10354298ba7260573627cdf8, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.248149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c3332-e11e-4611-b994-852586f2f671 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.248339 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc62358-0f3c-4585-ac1c-b95401358594 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.258895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc62358-0f3c-4585-ac1c-b95401358594 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.265374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1046/2098] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:11 2022] PUT /identity/v3/projects/33697b80b7624060bb6abea83e75f189/users/2fb4c80b10354298ba7260573627cdf8/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:11.277098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c6c6f-2d64-4635-9767-3349bfbbab83 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.277398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c6c6f-2d64-4635-9767-3349bfbbab83 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.277686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c6c6f-2d64-4635-9767-3349bfbbab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.284872 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:11.311142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-fb5c6c6f-2d64-4635-9767-3349bfbbab83 None None] MFA Rules not processed for user `2fb4c80b10354298ba7260573627cdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:11.313095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-fb5c6c6f-2d64-4635-9767-3349bfbbab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:11.346006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148f774-f7e8-4178-9218-4d3ec57ba97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.346722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148f774-f7e8-4178-9218-4d3ec57ba97f admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.347006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148f774-f7e8-4178-9218-4d3ec57ba97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.347295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148f774-f7e8-4178-9218-4d3ec57ba97f admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.347990 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148f774-f7e8-4178-9218-4d3ec57ba97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.352302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148f774-f7e8-4178-9218-4d3ec57ba97f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.385780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1053/2099] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:11 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:11.389916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148f774-f7e8-4178-9218-4d3ec57ba97f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.401935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1047/2100] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:11.406486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c6c6f-2d64-4635-9767-3349bfbbab83 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.429792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c6c6f-2d64-4635-9767-3349bfbbab83 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.477381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148f774-f7e8-4178-9218-4d3ec57ba97f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.487657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cd0de-01ee-455b-a194-9832bde4e80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.488379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cd0de-01ee-455b-a194-9832bde4e80f admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.488763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cd0de-01ee-455b-a194-9832bde4e80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.488924 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cd0de-01ee-455b-a194-9832bde4e80f admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.489621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cd0de-01ee-455b-a194-9832bde4e80f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.491544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cd0de-01ee-455b-a194-9832bde4e80f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.517747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ab3ba-7572-4ae6-b0fc-673847a3ecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.519055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ab3ba-7572-4ae6-b0fc-673847a3ecf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.519579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1054/2101] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:11 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:11.520093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ab3ba-7572-4ae6-b0fc-673847a3ecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.520485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ab3ba-7572-4ae6-b0fc-673847a3ecf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.521278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ab3ba-7572-4ae6-b0fc-673847a3ecf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.523399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ab3ba-7572-4ae6-b0fc-673847a3ecf8 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.524380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cd0de-01ee-455b-a194-9832bde4e80f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.536534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cd0de-01ee-455b-a194-9832bde4e80f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.544414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a6fc6-bea7-4cb4-b0cc-54c6901bdf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.545280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a6fc6-bea7-4cb4-b0cc-54c6901bdf00 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.545571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a6fc6-bea7-4cb4-b0cc-54c6901bdf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.545852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a6fc6-bea7-4cb4-b0cc-54c6901bdf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.546597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a6fc6-bea7-4cb4-b0cc-54c6901bdf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.548682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a6fc6-bea7-4cb4-b0cc-54c6901bdf00 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.550248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:11.557221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1048/2102] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:11 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:11.561474 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ab3ba-7572-4ae6-b0fc-673847a3ecf8 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.563834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1055/2103] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:11.567840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a6fc6-bea7-4cb4-b0cc-54c6901bdf00 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.579548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a6fc6-bea7-4cb4-b0cc-54c6901bdf00 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.645382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ab3ba-7572-4ae6-b0fc-673847a3ecf8 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.653204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d549cb-a81a-44e4-b7da-fad7f2ac9351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.653959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d549cb-a81a-44e4-b7da-fad7f2ac9351 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.654251 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d549cb-a81a-44e4-b7da-fad7f2ac9351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.654538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d549cb-a81a-44e4-b7da-fad7f2ac9351 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.655258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d549cb-a81a-44e4-b7da-fad7f2ac9351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.657221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d549cb-a81a-44e4-b7da-fad7f2ac9351 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.661344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e7675-9dcb-4b8e-8357-e7453739633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.662055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e7675-9dcb-4b8e-8357-e7453739633c admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.662342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e7675-9dcb-4b8e-8357-e7453739633c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.662682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e7675-9dcb-4b8e-8357-e7453739633c admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.663426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e7675-9dcb-4b8e-8357-e7453739633c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.667085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e7675-9dcb-4b8e-8357-e7453739633c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.681464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1056/2104] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:11.686908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1049/2105] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:11 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:11.689740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e7675-9dcb-4b8e-8357-e7453739633c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.690811 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d549cb-a81a-44e4-b7da-fad7f2ac9351 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.701876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d549cb-a81a-44e4-b7da-fad7f2ac9351 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.704428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e7675-9dcb-4b8e-8357-e7453739633c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.706666 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fd682-2ebd-45d3-b57d-3ca2e0ead040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.707368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fd682-2ebd-45d3-b57d-3ca2e0ead040 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.707658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fd682-2ebd-45d3-b57d-3ca2e0ead040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.707937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fd682-2ebd-45d3-b57d-3ca2e0ead040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.708793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fd682-2ebd-45d3-b57d-3ca2e0ead040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.710400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fd682-2ebd-45d3-b57d-3ca2e0ead040 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.711129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c358a29-b8aa-4ba0-ad44-06fb199aa819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.712916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c358a29-b8aa-4ba0-ad44-06fb199aa819 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.713293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:11.713561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c358a29-b8aa-4ba0-ad44-06fb199aa819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.713859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c358a29-b8aa-4ba0-ad44-06fb199aa819 admin admin] PATH_INFO: `/v3/projects/3627d07ff21c47ba8e12208449dd65b6/users/5856dfcdf87c42ceb1f84b8c9837c7a7/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.725574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1050/2106] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:11.726595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fd682-2ebd-45d3-b57d-3ca2e0ead040 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.736116 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c358a29-b8aa-4ba0-ad44-06fb199aa819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3627d07ff21c47ba8e12208449dd65b6, user_id=5856dfcdf87c42ceb1f84b8c9837c7a7, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.737790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fd682-2ebd-45d3-b57d-3ca2e0ead040 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.738982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c358a29-b8aa-4ba0-ad44-06fb199aa819 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.742500 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c749b-cde4-490d-a340-0ef0b937bb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.743156 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c749b-cde4-490d-a340-0ef0b937bb22 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.743531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c749b-cde4-490d-a340-0ef0b937bb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.743760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c749b-cde4-490d-a340-0ef0b937bb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.744676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c749b-cde4-490d-a340-0ef0b937bb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.746267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c749b-cde4-490d-a340-0ef0b937bb22 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.754852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1057/2107] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:11 2022] PUT /identity/v3/projects/3627d07ff21c47ba8e12208449dd65b6/users/5856dfcdf87c42ceb1f84b8c9837c7a7/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:11.759600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1051/2108] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:11.764802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c358a29-b8aa-4ba0-ad44-06fb199aa819 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.767019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fb105-6ef8-4727-b4b6-332f4c4cc7da None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.767421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fb105-6ef8-4727-b4b6-332f4c4cc7da None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.767714 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fb105-6ef8-4727-b4b6-332f4c4cc7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.800756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ca4fb105-6ef8-4727-b4b6-332f4c4cc7da None None] MFA Rules not processed for user `5856dfcdf87c42ceb1f84b8c9837c7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:11.802059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ca4fb105-6ef8-4727-b4b6-332f4c4cc7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:11.834125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c358a29-b8aa-4ba0-ad44-06fb199aa819 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.839466 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69476913-d4bd-46cc-8257-58200a4332b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.840395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69476913-d4bd-46cc-8257-58200a4332b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.840685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69476913-d4bd-46cc-8257-58200a4332b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.841086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69476913-d4bd-46cc-8257-58200a4332b2 admin admin] PATH_INFO: `/v3/projects/58fad437f1e7473da12fa3fb143834c1/users/b1c0f1a69f684755ae1d3403130752b3/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.856646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69476913-d4bd-46cc-8257-58200a4332b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fad437f1e7473da12fa3fb143834c1, user_id=b1c0f1a69f684755ae1d3403130752b3, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.859380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69476913-d4bd-46cc-8257-58200a4332b2 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.874775 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1058/2109] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:11 2022] PUT /identity/v3/projects/58fad437f1e7473da12fa3fb143834c1/users/b1c0f1a69f684755ae1d3403130752b3/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:11.892628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcabd7-4c18-49d5-a9a7-2b311bd9d7f7 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.893013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcabd7-4c18-49d5-a9a7-2b311bd9d7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.893320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1052/2110] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:11.893458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcabd7-4c18-49d5-a9a7-2b311bd9d7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.905141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fb105-6ef8-4727-b4b6-332f4c4cc7da None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.920655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-8bbcabd7-4c18-49d5-a9a7-2b311bd9d7f7 None None] MFA Rules not processed for user `b1c0f1a69f684755ae1d3403130752b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:11.921876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-8bbcabd7-4c18-49d5-a9a7-2b311bd9d7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:11.961481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:11.962635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fb105-6ef8-4727-b4b6-332f4c4cc7da None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.989026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1059/2111] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:11.993532 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcabd7-4c18-49d5-a9a7-2b311bd9d7f7 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:12.012896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7ee4c-41a1-4e73-89a8-58e6d0211eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:12.013647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ee4c-41a1-4e73-89a8-58e6d0211eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.014420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ee4c-41a1-4e73-89a8-58e6d0211eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.014708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ee4c-41a1-4e73-89a8-58e6d0211eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.059221 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcabd7-4c18-49d5-a9a7-2b311bd9d7f7 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:12.059456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:12.064262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d85b4a-8d65-46d8-9c0f-b6bf295cde79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:12.064944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d85b4a-8d65-46d8-9c0f-b6bf295cde79 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.065226 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d85b4a-8d65-46d8-9c0f-b6bf295cde79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.065502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d85b4a-8d65-46d8-9c0f-b6bf295cde79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.066182 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d85b4a-8d65-46d8-9c0f-b6bf295cde79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:12.068099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d85b4a-8d65-46d8-9c0f-b6bf295cde79 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:12.073654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7ee4c-41a1-4e73-89a8-58e6d0211eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:12.075356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7ee4c-41a1-4e73-89a8-58e6d0211eb4 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:12.085864 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1053/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:12.097547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1060/2113] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:11 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:12.098643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7ee4c-41a1-4e73-89a8-58e6d0211eb4 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:12.110437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7ee4c-41a1-4e73-89a8-58e6d0211eb4 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:12.175371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0e308-df34-49c7-87fc-aa77760e651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:12.176089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0e308-df34-49c7-87fc-aa77760e651c admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.176381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0e308-df34-49c7-87fc-aa77760e651c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.176663 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0e308-df34-49c7-87fc-aa77760e651c admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.177374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0e308-df34-49c7-87fc-aa77760e651c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:12.179325 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0e308-df34-49c7-87fc-aa77760e651c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:12.202270 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1054/2114] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:12 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:12.206823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d85b4a-8d65-46d8-9c0f-b6bf295cde79 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:12.219077 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d85b4a-8d65-46d8-9c0f-b6bf295cde79 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:12.224314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29a9a-73aa-46ee-917b-bd59cf3f72bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:12.225147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29a9a-73aa-46ee-917b-bd59cf3f72bc admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.225840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29a9a-73aa-46ee-917b-bd59cf3f72bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.225840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b29a9a-73aa-46ee-917b-bd59cf3f72bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.226849 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b29a9a-73aa-46ee-917b-bd59cf3f72bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:12.228653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b29a9a-73aa-46ee-917b-bd59cf3f72bc admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:12.240840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1061/2115] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:12.245244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0e308-df34-49c7-87fc-aa77760e651c admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:12.261936 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0e308-df34-49c7-87fc-aa77760e651c admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:12.267188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f1216-3abb-4fa4-aee8-78118a61e0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:12.268141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f1216-3abb-4fa4-aee8-78118a61e0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.268432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f1216-3abb-4fa4-aee8-78118a61e0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.268716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f1216-3abb-4fa4-aee8-78118a61e0ad admin admin] PATH_INFO: `/v3/projects/27c644023671427b9456b2ed15013d77/users/1b49f1e3695b44f9aee225baff765aaa/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.285390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f1216-3abb-4fa4-aee8-78118a61e0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c644023671427b9456b2ed15013d77, user_id=1b49f1e3695b44f9aee225baff765aaa, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:12.288721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f1216-3abb-4fa4-aee8-78118a61e0ad admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:12.303238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1055/2116] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:12 2022] PUT /identity/v3/projects/27c644023671427b9456b2ed15013d77/users/1b49f1e3695b44f9aee225baff765aaa/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:12.307237 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29a9a-73aa-46ee-917b-bd59cf3f72bc admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:12.318058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b29a9a-73aa-46ee-917b-bd59cf3f72bc admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:12.381071 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb62c0-71a3-418a-aa2f-ff2dfd761e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:12.381791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb62c0-71a3-418a-aa2f-ff2dfd761e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.382072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb62c0-71a3-418a-aa2f-ff2dfd761e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.382379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb62c0-71a3-418a-aa2f-ff2dfd761e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.383631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb62c0-71a3-418a-aa2f-ff2dfd761e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:12.386000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb62c0-71a3-418a-aa2f-ff2dfd761e7c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:12.405984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1062/2117] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:12.406187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f1216-3abb-4fa4-aee8-78118a61e0ad admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:12.415213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f1216-3abb-4fa4-aee8-78118a61e0ad admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:12.420168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de05240-4350-4791-a76c-d589296d2d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:12.421058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de05240-4350-4791-a76c-d589296d2d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.421328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de05240-4350-4791-a76c-d589296d2d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.421612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de05240-4350-4791-a76c-d589296d2d4c admin admin] PATH_INFO: `/v3/projects/27c644023671427b9456b2ed15013d77/users/1b49f1e3695b44f9aee225baff765aaa/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.423588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de05240-4350-4791-a76c-d589296d2d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c644023671427b9456b2ed15013d77, user_id=1b49f1e3695b44f9aee225baff765aaa, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:12.426266 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de05240-4350-4791-a76c-d589296d2d4c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:12.437208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1056/2118] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:12 2022] PUT /identity/v3/projects/27c644023671427b9456b2ed15013d77/users/1b49f1e3695b44f9aee225baff765aaa/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:12.448240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316f29c-122b-4372-b1a9-bd04cebc8621 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.448546 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316f29c-122b-4372-b1a9-bd04cebc8621 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.448837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316f29c-122b-4372-b1a9-bd04cebc8621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.483131 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c316f29c-122b-4372-b1a9-bd04cebc8621 None None] MFA Rules not processed for user `1b49f1e3695b44f9aee225baff765aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:12.484476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c316f29c-122b-4372-b1a9-bd04cebc8621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:12.524325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:12.552821 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1063/2119] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:12.564865 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de05240-4350-4791-a76c-d589296d2d4c admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:12.619130 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de05240-4350-4791-a76c-d589296d2d4c admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:12.622830 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636b568-9de3-4434-a82f-7ed0410735fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:12.623461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b568-9de3-4434-a82f-7ed0410735fa service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.623744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b568-9de3-4434-a82f-7ed0410735fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.624062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636b568-9de3-4434-a82f-7ed0410735fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.678232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:12.683096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636b568-9de3-4434-a82f-7ed0410735fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:12.685297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636b568-9de3-4434-a82f-7ed0410735fa service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:12.699565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1057/2120] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:14.301736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316f29c-122b-4372-b1a9-bd04cebc8621 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:14.311852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316f29c-122b-4372-b1a9-bd04cebc8621 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:14.315464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6570a93-a9fa-4957-a8ec-5d0fe8c84519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:14.316151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6570a93-a9fa-4957-a8ec-5d0fe8c84519 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:14.316439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6570a93-a9fa-4957-a8ec-5d0fe8c84519 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:14.317140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6570a93-a9fa-4957-a8ec-5d0fe8c84519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:14.393140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6570a93-a9fa-4957-a8ec-5d0fe8c84519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:14.394653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6570a93-a9fa-4957-a8ec-5d0fe8c84519 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:14.405969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1064/2121] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:14.806691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636b568-9de3-4434-a82f-7ed0410735fa service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:14.808280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6636b568-9de3-4434-a82f-7ed0410735fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:14.884530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636b568-9de3-4434-a82f-7ed0410735fa service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:14.889116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211b9f5-8324-46dd-b926-4969a1f90f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:14.890346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211b9f5-8324-46dd-b926-4969a1f90f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:14.890448 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211b9f5-8324-46dd-b926-4969a1f90f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:14.890797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211b9f5-8324-46dd-b926-4969a1f90f47 admin admin] PATH_INFO: `/v3/users/164fc427d381465ba8dde428eb7513fc` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:14.892214 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211b9f5-8324-46dd-b926-4969a1f90f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=164fc427d381465ba8dde428eb7513fc)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:14.893950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211b9f5-8324-46dd-b926-4969a1f90f47 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:14.964226 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2211b9f5-8324-46dd-b926-4969a1f90f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164fc427d381465ba8dde428eb7513fc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:14.979693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2211b9f5-8324-46dd-b926-4969a1f90f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164fc427d381465ba8dde428eb7513fc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:14.983451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2211b9f5-8324-46dd-b926-4969a1f90f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164fc427d381465ba8dde428eb7513fc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:14.990453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2211b9f5-8324-46dd-b926-4969a1f90f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164fc427d381465ba8dde428eb7513fc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:14.991905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6570a93-a9fa-4957-a8ec-5d0fe8c84519 service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:15.000050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2211b9f5-8324-46dd-b926-4969a1f90f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164fc427d381465ba8dde428eb7513fc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.002593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6570a93-a9fa-4957-a8ec-5d0fe8c84519 service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:15.006631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1058/2122] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:14 2022] DELETE /identity/v3/users/164fc427d381465ba8dde428eb7513fc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:15.007189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d398b2-e651-4457-abaf-607ad09cd191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:15.007952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d398b2-e651-4457-abaf-607ad09cd191 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:15.008340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d398b2-e651-4457-abaf-607ad09cd191 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:15.008734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d398b2-e651-4457-abaf-607ad09cd191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:15.010643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25b58-9ee0-4da0-b299-9bd76233b88a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:15.010759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-19d398b2-e651-4457-abaf-607ad09cd191 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:15.010936 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25b58-9ee0-4da0-b299-9bd76233b88a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:15.011217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25b58-9ee0-4da0-b299-9bd76233b88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:15.031756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-78d25b58-9ee0-4da0-b299-9bd76233b88a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:15.031926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d398b2-e651-4457-abaf-607ad09cd191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:15.033076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-78d25b58-9ee0-4da0-b299-9bd76233b88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:15.033621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d398b2-e651-4457-abaf-607ad09cd191 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:15.045233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1065/2123] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:15.084836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d398b2-e651-4457-abaf-607ad09cd191 service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:15.086729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-19d398b2-e651-4457-abaf-607ad09cd191 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:15.108390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d398b2-e651-4457-abaf-607ad09cd191 service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:15.109239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1059/2124] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:15.111876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d1268-f6bb-400f-be50-0aba5c46364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:15.112981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d1268-f6bb-400f-be50-0aba5c46364e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:15.113489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d1268-f6bb-400f-be50-0aba5c46364e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:15.113709 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d1268-f6bb-400f-be50-0aba5c46364e admin admin] PATH_INFO: `/v3/users/5856dfcdf87c42ceb1f84b8c9837c7a7` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:15.115861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d1268-f6bb-400f-be50-0aba5c46364e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5856dfcdf87c42ceb1f84b8c9837c7a7)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:15.116766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d25b58-9ee0-4da0-b299-9bd76233b88a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:15.118017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d1268-f6bb-400f-be50-0aba5c46364e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:15.119220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-78d25b58-9ee0-4da0-b299-9bd76233b88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:15.142092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:15.189855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-f89d1268-f6bb-400f-be50-0aba5c46364e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5856dfcdf87c42ceb1f84b8c9837c7a7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.191154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-f89d1268-f6bb-400f-be50-0aba5c46364e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5856dfcdf87c42ceb1f84b8c9837c7a7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.205941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-f89d1268-f6bb-400f-be50-0aba5c46364e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5856dfcdf87c42ceb1f84b8c9837c7a7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.206686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-f89d1268-f6bb-400f-be50-0aba5c46364e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5856dfcdf87c42ceb1f84b8c9837c7a7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.214896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-f89d1268-f6bb-400f-be50-0aba5c46364e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5856dfcdf87c42ceb1f84b8c9837c7a7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.215881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d25b58-9ee0-4da0-b299-9bd76233b88a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:15.220375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757838f-7b5a-450e-b2f5-d67b6273a239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:15.221144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757838f-7b5a-450e-b2f5-d67b6273a239 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:15.221498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757838f-7b5a-450e-b2f5-d67b6273a239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:15.221842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757838f-7b5a-450e-b2f5-d67b6273a239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:15.223716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8757838f-7b5a-450e-b2f5-d67b6273a239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:15.228308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1066/2125] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:15 2022] DELETE /identity/v3/users/5856dfcdf87c42ceb1f84b8c9837c7a7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:15.232736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189bb80-1203-4e5b-98fd-6609db3ace3d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:15.233029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189bb80-1203-4e5b-98fd-6609db3ace3d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:15.233362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189bb80-1203-4e5b-98fd-6609db3ace3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:15.236825 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757838f-7b5a-450e-b2f5-d67b6273a239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:15.238352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757838f-7b5a-450e-b2f5-d67b6273a239 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:15.249698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1060/2126] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:15.253836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-9189bb80-1203-4e5b-98fd-6609db3ace3d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:15.255328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9189bb80-1203-4e5b-98fd-6609db3ace3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:15.288906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:15.329332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1067/2127] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:15.341254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757838f-7b5a-450e-b2f5-d67b6273a239 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:15.345077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8757838f-7b5a-450e-b2f5-d67b6273a239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:15.357596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757838f-7b5a-450e-b2f5-d67b6273a239 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:15.422567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13dde5-908a-48ce-ae4a-7b8e5fe503a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:15.424021 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13dde5-908a-48ce-ae4a-7b8e5fe503a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:15.424317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13dde5-908a-48ce-ae4a-7b8e5fe503a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:15.424728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13dde5-908a-48ce-ae4a-7b8e5fe503a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:15.434703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13dde5-908a-48ce-ae4a-7b8e5fe503a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:15.436678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13dde5-908a-48ce-ae4a-7b8e5fe503a0 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:15.450843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1061/2128] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:26:15.645263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189bb80-1203-4e5b-98fd-6609db3ace3d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:15.646714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9189bb80-1203-4e5b-98fd-6609db3ace3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:15.664680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189bb80-1203-4e5b-98fd-6609db3ace3d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:15.671521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:15.673051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:15.673502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:15.673965 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] PATH_INFO: `/v3/projects/0abfbc318a934bc78917f631c4fed8a9` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:15.681187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abfbc318a934bc78917f631c4fed8a9)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:15.683696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:15.750161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abfbc318a934bc78917f631c4fed8a9', 'request_id': 'req-52a605ba-a4ae-4147-951f-e4b5bbafa904'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.757784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abfbc318a934bc78917f631c4fed8a9', 'request_id': 'req-52a605ba-a4ae-4147-951f-e4b5bbafa904'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.764735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abfbc318a934bc78917f631c4fed8a9', 'request_id': 'req-52a605ba-a4ae-4147-951f-e4b5bbafa904'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.776758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] The token cache is being invalidate because project 0abfbc318a934bc78917f631c4fed8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:15.777050 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.777702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.779497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1068/2129] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:15 2022] DELETE /identity/v3/projects/0abfbc318a934bc78917f631c4fed8a9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:15.783151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13dde5-908a-48ce-ae4a-7b8e5fe503a0 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:15.792912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13dde5-908a-48ce-ae4a-7b8e5fe503a0 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:15.852738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:15.853619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:15.853899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:15.854175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] PATH_INFO: `/v3/users/81f60ed46b294fda864be22e8515e5f0` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:15.855353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f60ed46b294fda864be22e8515e5f0)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:15.857318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:15.885722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:15.888106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:15.904259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a605ba-a4ae-4147-951f-e4b5bbafa904 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:15.910804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:15.911672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:15.911980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:15.912274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] PATH_INFO: `/v3/projects/3627d07ff21c47ba8e12208449dd65b6` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:15.913212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f60ed46b294fda864be22e8515e5f0'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.913463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3627d07ff21c47ba8e12208449dd65b6)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:15.915422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:15.924763 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:15.927294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f60ed46b294fda864be22e8515e5f0'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.928868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f60ed46b294fda864be22e8515e5f0'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.940283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f60ed46b294fda864be22e8515e5f0'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.947950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f60ed46b294fda864be22e8515e5f0'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.954138 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1062/2130] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:15 2022] DELETE /identity/v3/users/81f60ed46b294fda864be22e8515e5f0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:15.969142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3627d07ff21c47ba8e12208449dd65b6', 'request_id': 'req-ccac1a09-5a71-4a7f-8343-532592098d36'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.977113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3627d07ff21c47ba8e12208449dd65b6', 'request_id': 'req-ccac1a09-5a71-4a7f-8343-532592098d36'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.983016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3627d07ff21c47ba8e12208449dd65b6', 'request_id': 'req-ccac1a09-5a71-4a7f-8343-532592098d36'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.995453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] The token cache is being invalidate because project 3627d07ff21c47ba8e12208449dd65b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:15.995676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.996381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ccac1a09-5a71-4a7f-8343-532592098d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:15.997930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1069/2131] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:15 2022] DELETE /identity/v3/projects/3627d07ff21c47ba8e12208449dd65b6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:16.248792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:16.252016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:16.324385 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ec3ad-8487-451e-b452-de17e66830e3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:16.329142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:16.330001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:16.330284 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:16.330680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] PATH_INFO: `/v3/projects/fc763117a2464796a14d71bba780bcf7` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:16.331917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc763117a2464796a14d71bba780bcf7)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:16.334583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:16.386479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc763117a2464796a14d71bba780bcf7', 'request_id': 'req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:16.395661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc763117a2464796a14d71bba780bcf7', 'request_id': 'req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:16.402807 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc763117a2464796a14d71bba780bcf7', 'request_id': 'req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:16.414818 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] The token cache is being invalidate because project fc763117a2464796a14d71bba780bcf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:16.415160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:16.416330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e466a2ce-dae2-4de8-b375-96a80ee3d3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:16.418115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1063/2132] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:16 2022] DELETE /identity/v3/projects/fc763117a2464796a14d71bba780bcf7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:16.422921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90c6ae-d6c5-49f9-99c8-2a08298f7873 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:16.423386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90c6ae-d6c5-49f9-99c8-2a08298f7873 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:16.423482 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90c6ae-d6c5-49f9-99c8-2a08298f7873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:16.445700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-0e90c6ae-d6c5-49f9-99c8-2a08298f7873 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:16.447149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-0e90c6ae-d6c5-49f9-99c8-2a08298f7873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:16.486842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:16.518127 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1070/2133] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:16.526433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa40aa-f47b-40c8-bba5-635f47b6c116 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:16.526730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa40aa-f47b-40c8-bba5-635f47b6c116 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:16.527017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa40aa-f47b-40c8-bba5-635f47b6c116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:16.545578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-61fa40aa-f47b-40c8-bba5-635f47b6c116 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:16.546783 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-61fa40aa-f47b-40c8-bba5-635f47b6c116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:16.554630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1064/2134] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:16.558794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90c6ae-d6c5-49f9-99c8-2a08298f7873 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:16.568435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90c6ae-d6c5-49f9-99c8-2a08298f7873 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:16.573738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaefc5-7cd5-416f-aebb-afb4d0c75510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:16.574677 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaefc5-7cd5-416f-aebb-afb4d0c75510 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:16.574961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaefc5-7cd5-416f-aebb-afb4d0c75510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:16.575242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaefc5-7cd5-416f-aebb-afb4d0c75510 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:16.575999 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaefc5-7cd5-416f-aebb-afb4d0c75510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:16.576302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaefc5-7cd5-416f-aebb-afb4d0c75510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:16.577891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaefc5-7cd5-416f-aebb-afb4d0c75510 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:16.590943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1071/2135] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:16.595015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa40aa-f47b-40c8-bba5-635f47b6c116 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:16.606416 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa40aa-f47b-40c8-bba5-635f47b6c116 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:16.611283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b94f-4c6a-4f15-9ea4-19fc4df581e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:16.612426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b94f-4c6a-4f15-9ea4-19fc4df581e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:16.612426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b94f-4c6a-4f15-9ea4-19fc4df581e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:16.612647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b94f-4c6a-4f15-9ea4-19fc4df581e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:16.613283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50b94f-4c6a-4f15-9ea4-19fc4df581e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:16.615539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50b94f-4c6a-4f15-9ea4-19fc4df581e7 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:16.642183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1065/2136] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:16 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:16.646479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaefc5-7cd5-416f-aebb-afb4d0c75510 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:16.657542 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaefc5-7cd5-416f-aebb-afb4d0c75510 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:16.718356 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26b421-77ba-44a9-9414-09fea817cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:16.718935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b421-77ba-44a9-9414-09fea817cd3d admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:16.719220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b421-77ba-44a9-9414-09fea817cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:16.719499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26b421-77ba-44a9-9414-09fea817cd3d admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:16.720350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26b421-77ba-44a9-9414-09fea817cd3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:16.722267 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26b421-77ba-44a9-9414-09fea817cd3d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:16.743121 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1072/2137] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:16 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:16.747178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b94f-4c6a-4f15-9ea4-19fc4df581e7 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:16.757802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b94f-4c6a-4f15-9ea4-19fc4df581e7 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:16.764095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e505ea-4f94-431c-ae17-6e5c9e286e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:16.764901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e505ea-4f94-431c-ae17-6e5c9e286e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:16.765297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e505ea-4f94-431c-ae17-6e5c9e286e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:16.765582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e505ea-4f94-431c-ae17-6e5c9e286e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:16.766353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e505ea-4f94-431c-ae17-6e5c9e286e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:16.767958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e505ea-4f94-431c-ae17-6e5c9e286e52 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:16.779167 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1066/2138] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:16.783086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26b421-77ba-44a9-9414-09fea817cd3d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:16.793253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26b421-77ba-44a9-9414-09fea817cd3d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:16.797852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e293da-58d4-42bb-bdde-5b4be46849dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:16.798506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e293da-58d4-42bb-bdde-5b4be46849dd admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:16.798790 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e293da-58d4-42bb-bdde-5b4be46849dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:16.799068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e293da-58d4-42bb-bdde-5b4be46849dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:16.799795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e293da-58d4-42bb-bdde-5b4be46849dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:16.801409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e293da-58d4-42bb-bdde-5b4be46849dd admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:16.811093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1073/2139] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:16.815241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e505ea-4f94-431c-ae17-6e5c9e286e52 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:16.826084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e505ea-4f94-431c-ae17-6e5c9e286e52 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:16.830713 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a502ab-819d-4142-b3ed-a96f0d41431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:16.831586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a502ab-819d-4142-b3ed-a96f0d41431e admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:16.831894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a502ab-819d-4142-b3ed-a96f0d41431e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:16.832212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a502ab-819d-4142-b3ed-a96f0d41431e admin admin] PATH_INFO: `/v3/projects/de2e5e1416f643b5b6d57ec3fd563f3d/users/ad2bc9fe6299478b99f8c9051cd2b340/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:16.850709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a502ab-819d-4142-b3ed-a96f0d41431e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2e5e1416f643b5b6d57ec3fd563f3d, user_id=ad2bc9fe6299478b99f8c9051cd2b340, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:16.855597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a502ab-819d-4142-b3ed-a96f0d41431e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:16.876654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1067/2140] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:16 2022] PUT /identity/v3/projects/de2e5e1416f643b5b6d57ec3fd563f3d/users/ad2bc9fe6299478b99f8c9051cd2b340/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:16.889680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e86fb9-07ff-4bfe-94ce-ddb4dcf0c7d9 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:16.890019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e86fb9-07ff-4bfe-94ce-ddb4dcf0c7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:16.890310 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e86fb9-07ff-4bfe-94ce-ddb4dcf0c7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:16.917680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e4e86fb9-07ff-4bfe-94ce-ddb4dcf0c7d9 None None] MFA Rules not processed for user `ad2bc9fe6299478b99f8c9051cd2b340`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:16.918912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e4e86fb9-07ff-4bfe-94ce-ddb4dcf0c7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:16.993977 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1074/2141] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:16.998920 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a502ab-819d-4142-b3ed-a96f0d41431e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:17.005034 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:17.099718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a502ab-819d-4142-b3ed-a96f0d41431e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:17.110389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1218b-3d6a-4278-a1a6-cebc74a3a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:17.112230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1218b-3d6a-4278-a1a6-cebc74a3a41e admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:17.112230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1218b-3d6a-4278-a1a6-cebc74a3a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:17.112230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1218b-3d6a-4278-a1a6-cebc74a3a41e admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:17.112758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1218b-3d6a-4278-a1a6-cebc74a3a41e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:17.115049 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1218b-3d6a-4278-a1a6-cebc74a3a41e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:17.148640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1068/2142] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:16 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:17.150182 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e86fb9-07ff-4bfe-94ce-ddb4dcf0c7d9 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:17.162593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e86fb9-07ff-4bfe-94ce-ddb4dcf0c7d9 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:17.201802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:17.235308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f4a70-9b62-41f5-bbd3-5df05640aadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:17.236022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f4a70-9b62-41f5-bbd3-5df05640aadb admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:17.236314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f4a70-9b62-41f5-bbd3-5df05640aadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:17.236588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f4a70-9b62-41f5-bbd3-5df05640aadb admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:17.237285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f4a70-9b62-41f5-bbd3-5df05640aadb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:17.239197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f4a70-9b62-41f5-bbd3-5df05640aadb admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:17.265723 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1075/2143] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:17 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:17.270108 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1218b-3d6a-4278-a1a6-cebc74a3a41e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:17.280648 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1218b-3d6a-4278-a1a6-cebc74a3a41e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:17.285361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2f912-1a53-40a9-9f2e-f39c99777a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:17.286030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2f912-1a53-40a9-9f2e-f39c99777a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:17.286314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2f912-1a53-40a9-9f2e-f39c99777a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:17.286595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2f912-1a53-40a9-9f2e-f39c99777a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:17.287422 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2f912-1a53-40a9-9f2e-f39c99777a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:17.288980 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2f912-1a53-40a9-9f2e-f39c99777a8b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:17.300839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1069/2144] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:17.305022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f4a70-9b62-41f5-bbd3-5df05640aadb admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:17.315428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f4a70-9b62-41f5-bbd3-5df05640aadb admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:17.320068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e32f18-4af9-407e-bad6-aa16e19b27db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:17.320977 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e32f18-4af9-407e-bad6-aa16e19b27db admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:17.321285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e32f18-4af9-407e-bad6-aa16e19b27db admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:17.321572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e32f18-4af9-407e-bad6-aa16e19b27db admin admin] PATH_INFO: `/v3/projects/05ecbb7fc1f8472e99dcc24100c12bf9/users/ec9c63a9efff48e8bb6a67b84084d317/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:17.337182 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e32f18-4af9-407e-bad6-aa16e19b27db admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ecbb7fc1f8472e99dcc24100c12bf9, user_id=ec9c63a9efff48e8bb6a67b84084d317, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:17.339851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e32f18-4af9-407e-bad6-aa16e19b27db admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:17.353985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1076/2145] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:17 2022] PUT /identity/v3/projects/05ecbb7fc1f8472e99dcc24100c12bf9/users/ec9c63a9efff48e8bb6a67b84084d317/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:17.357711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2f912-1a53-40a9-9f2e-f39c99777a8b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:17.367746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2f912-1a53-40a9-9f2e-f39c99777a8b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:17.427349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73332840-912b-4ba9-a682-22a09cb6da39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:17.428031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332840-912b-4ba9-a682-22a09cb6da39 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:17.428324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332840-912b-4ba9-a682-22a09cb6da39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:17.428602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332840-912b-4ba9-a682-22a09cb6da39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:17.429314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73332840-912b-4ba9-a682-22a09cb6da39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:17.431513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73332840-912b-4ba9-a682-22a09cb6da39 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:17.441060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1070/2146] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:17.445227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e32f18-4af9-407e-bad6-aa16e19b27db admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:17.455710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e32f18-4af9-407e-bad6-aa16e19b27db admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:17.460346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14628245-cc1a-426c-bcb4-22bc7a06965e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:17.461250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14628245-cc1a-426c-bcb4-22bc7a06965e admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:17.461536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14628245-cc1a-426c-bcb4-22bc7a06965e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:17.461814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14628245-cc1a-426c-bcb4-22bc7a06965e admin admin] PATH_INFO: `/v3/projects/05ecbb7fc1f8472e99dcc24100c12bf9/users/ec9c63a9efff48e8bb6a67b84084d317/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:17.463822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14628245-cc1a-426c-bcb4-22bc7a06965e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ecbb7fc1f8472e99dcc24100c12bf9, user_id=ec9c63a9efff48e8bb6a67b84084d317, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:17.466488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14628245-cc1a-426c-bcb4-22bc7a06965e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:17.477149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1077/2147] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:17 2022] PUT /identity/v3/projects/05ecbb7fc1f8472e99dcc24100c12bf9/users/ec9c63a9efff48e8bb6a67b84084d317/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:17.487565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476300-e9e0-46f9-8015-7fefe2dee4d0 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:17.487863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476300-e9e0-46f9-8015-7fefe2dee4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:17.488214 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476300-e9e0-46f9-8015-7fefe2dee4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:17.516432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e1476300-e9e0-46f9-8015-7fefe2dee4d0 None None] MFA Rules not processed for user `ec9c63a9efff48e8bb6a67b84084d317`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:17.517708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e1476300-e9e0-46f9-8015-7fefe2dee4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:17.587391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:17.591208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1071/2148] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:17.603432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14628245-cc1a-426c-bcb4-22bc7a06965e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:17.605175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-14628245-cc1a-426c-bcb4-22bc7a06965e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:17.662693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14628245-cc1a-426c-bcb4-22bc7a06965e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:17.666939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ecf0d-f13c-418e-bd38-acd324e359fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:17.667584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ecf0d-f13c-418e-bd38-acd324e359fe service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:17.667873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ecf0d-f13c-418e-bd38-acd324e359fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:17.668180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ecf0d-f13c-418e-bd38-acd324e359fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:17.677434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ecf0d-f13c-418e-bd38-acd324e359fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:17.678853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ecf0d-f13c-418e-bd38-acd324e359fe service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:17.690467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1078/2149] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:17.776906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476300-e9e0-46f9-8015-7fefe2dee4d0 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:17.858291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476300-e9e0-46f9-8015-7fefe2dee4d0 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:17.864052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:17.864731 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:17.865013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:17.865285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] PATH_INFO: `/v3/users/ad2bc9fe6299478b99f8c9051cd2b340` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:17.866508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2bc9fe6299478b99f8c9051cd2b340)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:17.869315 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:17.916931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2bc9fe6299478b99f8c9051cd2b340'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:17.933237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2bc9fe6299478b99f8c9051cd2b340'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:17.933966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2bc9fe6299478b99f8c9051cd2b340'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:17.940878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2bc9fe6299478b99f8c9051cd2b340'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:17.948392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2bc9fe6299478b99f8c9051cd2b340'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:17.954392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1072/2150] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:17 2022] DELETE /identity/v3/users/ad2bc9fe6299478b99f8c9051cd2b340 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:17.958816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08015-6029-4fe4-bb04-d88687987d33 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:17.959110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08015-6029-4fe4-bb04-d88687987d33 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:17.959396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08015-6029-4fe4-bb04-d88687987d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:17.976822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f8c08015-6029-4fe4-bb04-d88687987d33 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:17.978568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f8c08015-6029-4fe4-bb04-d88687987d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:18.042055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1079/2151] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:18.052295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:18.053717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:18.110293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2468e-a25e-44d8-b094-d632eb794099 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:18.114387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e39e6-f5e7-4af7-bf1c-a989f12011e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:18.115105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e39e6-f5e7-4af7-bf1c-a989f12011e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:18.115394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e39e6-f5e7-4af7-bf1c-a989f12011e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:18.115674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e39e6-f5e7-4af7-bf1c-a989f12011e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:18.125417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e39e6-f5e7-4af7-bf1c-a989f12011e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:18.126836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e39e6-f5e7-4af7-bf1c-a989f12011e1 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:18.136107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1073/2152] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:26:18.478466 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c08015-6029-4fe4-bb04-d88687987d33 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:18.484920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f8c08015-6029-4fe4-bb04-d88687987d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:18.502045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c08015-6029-4fe4-bb04-d88687987d33 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:18.507064 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:18.507940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:18.508296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:18.508516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] PATH_INFO: `/v3/projects/de2e5e1416f643b5b6d57ec3fd563f3d` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:18.509761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2e5e1416f643b5b6d57ec3fd563f3d)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:18.511730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:18.543195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:18.561670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2e5e1416f643b5b6d57ec3fd563f3d', 'request_id': 'req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:18.568192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2e5e1416f643b5b6d57ec3fd563f3d', 'request_id': 'req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:18.573614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2e5e1416f643b5b6d57ec3fd563f3d', 'request_id': 'req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:18.584928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] The token cache is being invalidate because project de2e5e1416f643b5b6d57ec3fd563f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:18.585214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:18.585840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:18.587898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1080/2153] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:18 2022] DELETE /identity/v3/projects/de2e5e1416f643b5b6d57ec3fd563f3d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:18.592092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e39e6-f5e7-4af7-bf1c-a989f12011e1 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:18.601824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e39e6-f5e7-4af7-bf1c-a989f12011e1 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:18.620656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:18.660276 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:18.661139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:18.661420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:18.661693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] PATH_INFO: `/v3/users/ec9c63a9efff48e8bb6a67b84084d317` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:18.662871 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9c63a9efff48e8bb6a67b84084d317)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:18.664835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:18.710377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9c63a9efff48e8bb6a67b84084d317'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:18.722493 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9c63a9efff48e8bb6a67b84084d317'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:18.723143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9c63a9efff48e8bb6a67b84084d317'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:18.730754 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9c63a9efff48e8bb6a67b84084d317'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:18.737827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9c63a9efff48e8bb6a67b84084d317'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:18.743761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1074/2154] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:18 2022] DELETE /identity/v3/users/ec9c63a9efff48e8bb6a67b84084d317 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:18.955105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:18.959898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:18.977497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ae49-2197-4cac-b1f0-5e73f70ed1e5 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.044482 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5479636-12a8-4dac-a266-67490ba031f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.045487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5479636-12a8-4dac-a266-67490ba031f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.045794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5479636-12a8-4dac-a266-67490ba031f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.046075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5479636-12a8-4dac-a266-67490ba031f9 admin admin] PATH_INFO: `/v3/users/2fb4c80b10354298ba7260573627cdf8` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.047287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5479636-12a8-4dac-a266-67490ba031f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb4c80b10354298ba7260573627cdf8)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.049272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5479636-12a8-4dac-a266-67490ba031f9 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.100932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c5479636-12a8-4dac-a266-67490ba031f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb4c80b10354298ba7260573627cdf8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.102239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c5479636-12a8-4dac-a266-67490ba031f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb4c80b10354298ba7260573627cdf8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.112798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.115568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:19.117836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c5479636-12a8-4dac-a266-67490ba031f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb4c80b10354298ba7260573627cdf8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.119368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c5479636-12a8-4dac-a266-67490ba031f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb4c80b10354298ba7260573627cdf8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.128804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c5479636-12a8-4dac-a266-67490ba031f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb4c80b10354298ba7260573627cdf8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.135091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f970ad3-bfc1-4792-9d92-4a2513e77e8f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.139886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.140935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.141231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.141513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] PATH_INFO: `/v3/projects/05ecbb7fc1f8472e99dcc24100c12bf9` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.143202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ecbb7fc1f8472e99dcc24100c12bf9)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.145166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.165425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1081/2155] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:18 2022] DELETE /identity/v3/users/2fb4c80b10354298ba7260573627cdf8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:19.165425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de467-ef3b-4d94-86b1-c38b00b7e0a4 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.165425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de467-ef3b-4d94-86b1-c38b00b7e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.165425 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de467-ef3b-4d94-86b1-c38b00b7e0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.178568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e20de467-ef3b-4d94-86b1-c38b00b7e0a4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:19.182241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e20de467-ef3b-4d94-86b1-c38b00b7e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:19.206083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ecbb7fc1f8472e99dcc24100c12bf9', 'request_id': 'req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.214041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ecbb7fc1f8472e99dcc24100c12bf9', 'request_id': 'req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.216996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:19.219908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ecbb7fc1f8472e99dcc24100c12bf9', 'request_id': 'req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.233118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] The token cache is being invalidate because project 05ecbb7fc1f8472e99dcc24100c12bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:19.233407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.234076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a1ba1bda-96b0-4b3e-a09b-5da7a276c189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.235866 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1075/2156] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:19 2022] DELETE /identity/v3/projects/05ecbb7fc1f8472e99dcc24100c12bf9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:19.240482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611d30-0569-4d19-9f18-7490fe256b75 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.240775 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611d30-0569-4d19-9f18-7490fe256b75 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.241087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611d30-0569-4d19-9f18-7490fe256b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.253728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1082/2157] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:19.259828 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7f611d30-0569-4d19-9f18-7490fe256b75 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:19.261058 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7f611d30-0569-4d19-9f18-7490fe256b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:19.263804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20de467-ef3b-4d94-86b1-c38b00b7e0a4 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.265145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e20de467-ef3b-4d94-86b1-c38b00b7e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:19.279724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:19.321896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1076/2158] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:19.324563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20de467-ef3b-4d94-86b1-c38b00b7e0a4 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.329609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca028-47ed-4aca-bc43-f3ec482434ca None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.329907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca028-47ed-4aca-bc43-f3ec482434ca None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.330189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca028-47ed-4aca-bc43-f3ec482434ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.348468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e3eca028-47ed-4aca-bc43-f3ec482434ca None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:19.349664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e3eca028-47ed-4aca-bc43-f3ec482434ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:19.357689 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1077/2159] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:19.361794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca028-47ed-4aca-bc43-f3ec482434ca None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.371232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca028-47ed-4aca-bc43-f3ec482434ca None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.373138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84cafd-4c0f-48f7-9ca7-8cbdf0753176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.373785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84cafd-4c0f-48f7-9ca7-8cbdf0753176 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.374068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84cafd-4c0f-48f7-9ca7-8cbdf0753176 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.374348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84cafd-4c0f-48f7-9ca7-8cbdf0753176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.375952 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013337da-d5fc-4cc8-ade2-ba90744c8d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.376614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013337da-d5fc-4cc8-ade2-ba90744c8d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.376898 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013337da-d5fc-4cc8-ade2-ba90744c8d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.377178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013337da-d5fc-4cc8-ade2-ba90744c8d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.377894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013337da-d5fc-4cc8-ade2-ba90744c8d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:19.378203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013337da-d5fc-4cc8-ade2-ba90744c8d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.379786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013337da-d5fc-4cc8-ade2-ba90744c8d1f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.383465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84cafd-4c0f-48f7-9ca7-8cbdf0753176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.385512 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84cafd-4c0f-48f7-9ca7-8cbdf0753176 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.393062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1078/2160] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:26:19.395551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1083/2161] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:26:19.397261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013337da-d5fc-4cc8-ade2-ba90744c8d1f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.406989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013337da-d5fc-4cc8-ade2-ba90744c8d1f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.411639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4d9d9-0455-4f59-b697-431ff63cb9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.412306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d9d9-0455-4f59-b697-431ff63cb9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.412592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d9d9-0455-4f59-b697-431ff63cb9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.412870 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d9d9-0455-4f59-b697-431ff63cb9a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.413640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4d9d9-0455-4f59-b697-431ff63cb9a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.415664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4d9d9-0455-4f59-b697-431ff63cb9a8 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.441696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1079/2162] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:19 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:19.446012 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84cafd-4c0f-48f7-9ca7-8cbdf0753176 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.456976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84cafd-4c0f-48f7-9ca7-8cbdf0753176 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.525615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb0f3-41b2-46d9-8bb1-622a03b0597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.526327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb0f3-41b2-46d9-8bb1-622a03b0597f admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.526623 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb0f3-41b2-46d9-8bb1-622a03b0597f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.526903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb0f3-41b2-46d9-8bb1-622a03b0597f admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.528451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fb0f3-41b2-46d9-8bb1-622a03b0597f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.530133 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fb0f3-41b2-46d9-8bb1-622a03b0597f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.555739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1084/2163] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:19 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:19.565405 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4d9d9-0455-4f59-b697-431ff63cb9a8 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.588500 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4d9d9-0455-4f59-b697-431ff63cb9a8 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.593816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a9d86-f2fd-48c8-8893-e4bd984601fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.594531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9d86-f2fd-48c8-8893-e4bd984601fc admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.594950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9d86-f2fd-48c8-8893-e4bd984601fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.595278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a9d86-f2fd-48c8-8893-e4bd984601fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.596079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a9d86-f2fd-48c8-8893-e4bd984601fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.597711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a9d86-f2fd-48c8-8893-e4bd984601fc admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.608802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1080/2164] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:19.612612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb0f3-41b2-46d9-8bb1-622a03b0597f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.623904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb0f3-41b2-46d9-8bb1-622a03b0597f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.628617 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089f5df-fa34-49de-a10a-b8c43637c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.629296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089f5df-fa34-49de-a10a-b8c43637c8af admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.629583 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089f5df-fa34-49de-a10a-b8c43637c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.630193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089f5df-fa34-49de-a10a-b8c43637c8af admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.630591 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089f5df-fa34-49de-a10a-b8c43637c8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.632230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089f5df-fa34-49de-a10a-b8c43637c8af admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.643474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1085/2165] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:19.648053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a9d86-f2fd-48c8-8893-e4bd984601fc admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.658571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a9d86-f2fd-48c8-8893-e4bd984601fc admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.663268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a644c91-60a7-4863-9e5d-c5342f42ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.664179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644c91-60a7-4863-9e5d-c5342f42ef78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.664469 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644c91-60a7-4863-9e5d-c5342f42ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.664746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644c91-60a7-4863-9e5d-c5342f42ef78 admin admin] PATH_INFO: `/v3/projects/2b26f364db9941b6bfc1128a27d325f2/users/8cd6fb0ab6db4f4ebb24985d847fc5e6/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.682334 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a644c91-60a7-4863-9e5d-c5342f42ef78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b26f364db9941b6bfc1128a27d325f2, user_id=8cd6fb0ab6db4f4ebb24985d847fc5e6, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.685086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a644c91-60a7-4863-9e5d-c5342f42ef78 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.711151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1081/2166] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:19 2022] PUT /identity/v3/projects/2b26f364db9941b6bfc1128a27d325f2/users/8cd6fb0ab6db4f4ebb24985d847fc5e6/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:19.713263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b4375-c015-4500-a904-57424657fb33 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.713619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b4375-c015-4500-a904-57424657fb33 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.713906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b4375-c015-4500-a904-57424657fb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.736652 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:19.757193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-250b4375-c015-4500-a904-57424657fb33 None None] MFA Rules not processed for user `8cd6fb0ab6db4f4ebb24985d847fc5e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:19.759378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-250b4375-c015-4500-a904-57424657fb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:19.762131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a644c91-60a7-4863-9e5d-c5342f42ef78 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.764141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2a644c91-60a7-4863-9e5d-c5342f42ef78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:19.835470 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1086/2167] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:19.840314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b4375-c015-4500-a904-57424657fb33 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.843024 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a644c91-60a7-4863-9e5d-c5342f42ef78 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.847862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.848832 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.849120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.849397 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] PATH_INFO: `/v3/projects/33697b80b7624060bb6abea83e75f189` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.850572 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=33697b80b7624060bb6abea83e75f189)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.851034 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b4375-c015-4500-a904-57424657fb33 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.853094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.856233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc774b-d35c-4377-8fc3-a0d9128a5061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.856897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc774b-d35c-4377-8fc3-a0d9128a5061 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.857179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc774b-d35c-4377-8fc3-a0d9128a5061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.857452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc774b-d35c-4377-8fc3-a0d9128a5061 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.858136 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc774b-d35c-4377-8fc3-a0d9128a5061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.860083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc774b-d35c-4377-8fc3-a0d9128a5061 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.885654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1087/2168] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:19 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:19.889711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc774b-d35c-4377-8fc3-a0d9128a5061 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.903908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33697b80b7624060bb6abea83e75f189', 'request_id': 'req-06f2b234-7d38-49a7-b12b-fad94eea5cbd'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.905575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:19.912060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33697b80b7624060bb6abea83e75f189', 'request_id': 'req-06f2b234-7d38-49a7-b12b-fad94eea5cbd'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.919358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33697b80b7624060bb6abea83e75f189', 'request_id': 'req-06f2b234-7d38-49a7-b12b-fad94eea5cbd'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.930885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] The token cache is being invalidate because project 33697b80b7624060bb6abea83e75f189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:19.931179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.932310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:19.934377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1082/2169] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:19 2022] DELETE /identity/v3/projects/33697b80b7624060bb6abea83e75f189 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:19.938092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.939574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:19.955577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc774b-d35c-4377-8fc3-a0d9128a5061 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.003771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2b234-7d38-49a7-b12b-fad94eea5cbd admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.008561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.009488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.009723 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.009996 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] PATH_INFO: `/v3/users/b1c0f1a69f684755ae1d3403130752b3` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.010774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc3749-fc5e-4d7c-b168-00c776568d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.011186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c0f1a69f684755ae1d3403130752b3)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.011441 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc3749-fc5e-4d7c-b168-00c776568d51 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.011729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc3749-fc5e-4d7c-b168-00c776568d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.012036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc3749-fc5e-4d7c-b168-00c776568d51 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.012726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc3749-fc5e-4d7c-b168-00c776568d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.013209 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:20.014657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc3749-fc5e-4d7c-b168-00c776568d51 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:20.038357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1088/2170] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:19 2022] POST /identity/v3/users => generated 301 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:20.039389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc3749-fc5e-4d7c-b168-00c776568d51 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:20.041655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-63dc3749-fc5e-4d7c-b168-00c776568d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:20.055024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc3749-fc5e-4d7c-b168-00c776568d51 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.060192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f37e8-4777-4261-918b-8f1ec4f51098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.060974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f37e8-4777-4261-918b-8f1ec4f51098 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.061291 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f37e8-4777-4261-918b-8f1ec4f51098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.061573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f37e8-4777-4261-918b-8f1ec4f51098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.062305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f37e8-4777-4261-918b-8f1ec4f51098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.063897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f37e8-4777-4261-918b-8f1ec4f51098 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:20.067384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c0f1a69f684755ae1d3403130752b3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.074548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1089/2171] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:20.078492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f37e8-4777-4261-918b-8f1ec4f51098 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:20.080711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c0f1a69f684755ae1d3403130752b3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.081431 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c0f1a69f684755ae1d3403130752b3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.084568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:20.089378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f37e8-4777-4261-918b-8f1ec4f51098 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.090155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c0f1a69f684755ae1d3403130752b3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.095403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98af85-2796-4146-868d-f90fe6b6e338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.096323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98af85-2796-4146-868d-f90fe6b6e338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.096614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98af85-2796-4146-868d-f90fe6b6e338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.096891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98af85-2796-4146-868d-f90fe6b6e338 admin admin] PATH_INFO: `/v3/projects/6463455eae2b4292b24645d69b5288bd/users/f1c2c01530994f80b6cb0675d06201c3/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.097691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c0f1a69f684755ae1d3403130752b3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.104555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1083/2172] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:19 2022] DELETE /identity/v3/users/b1c0f1a69f684755ae1d3403130752b3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:20.113310 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98af85-2796-4146-868d-f90fe6b6e338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6463455eae2b4292b24645d69b5288bd, user_id=f1c2c01530994f80b6cb0675d06201c3, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.115989 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d98af85-2796-4146-868d-f90fe6b6e338 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:20.129231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1090/2173] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:20 2022] PUT /identity/v3/projects/6463455eae2b4292b24645d69b5288bd/users/f1c2c01530994f80b6cb0675d06201c3/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:20.133091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:20.134889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:20.210132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:20.214519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70974b4c-24c9-4834-a8f7-ec885cac9ac5 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.280820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b613a-5677-49a6-8fa1-eb1644c2a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.281577 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b613a-5677-49a6-8fa1-eb1644c2a3da admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.282202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b613a-5677-49a6-8fa1-eb1644c2a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.282202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b613a-5677-49a6-8fa1-eb1644c2a3da admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.283042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b613a-5677-49a6-8fa1-eb1644c2a3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.284830 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b613a-5677-49a6-8fa1-eb1644c2a3da admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:20.297454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1084/2174] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:20.301910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98af85-2796-4146-868d-f90fe6b6e338 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:20.314715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98af85-2796-4146-868d-f90fe6b6e338 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.319546 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9cd1e-1f78-4afe-a0b4-b5bf23e83e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.321048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9cd1e-1f78-4afe-a0b4-b5bf23e83e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.321866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9cd1e-1f78-4afe-a0b4-b5bf23e83e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.322150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9cd1e-1f78-4afe-a0b4-b5bf23e83e23 admin admin] PATH_INFO: `/v3/projects/6463455eae2b4292b24645d69b5288bd/users/f1c2c01530994f80b6cb0675d06201c3/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.325144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9cd1e-1f78-4afe-a0b4-b5bf23e83e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6463455eae2b4292b24645d69b5288bd, user_id=f1c2c01530994f80b6cb0675d06201c3, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.327916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9cd1e-1f78-4afe-a0b4-b5bf23e83e23 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:20.340006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1091/2175] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:20 2022] PUT /identity/v3/projects/6463455eae2b4292b24645d69b5288bd/users/f1c2c01530994f80b6cb0675d06201c3/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:20.350219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df1ba3-2f43-4ab6-bb78-9878a9aae0cc None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.350512 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df1ba3-2f43-4ab6-bb78-9878a9aae0cc None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.350793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df1ba3-2f43-4ab6-bb78-9878a9aae0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.379619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-45df1ba3-2f43-4ab6-bb78-9878a9aae0cc None None] MFA Rules not processed for user `f1c2c01530994f80b6cb0675d06201c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:20.380856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-45df1ba3-2f43-4ab6-bb78-9878a9aae0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:20.419890 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9cd1e-1f78-4afe-a0b4-b5bf23e83e23 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:20.421739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7de9cd1e-1f78-4afe-a0b4-b5bf23e83e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:20.466414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1085/2176] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:20.477171 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df1ba3-2f43-4ab6-bb78-9878a9aae0cc None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:20.478616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-45df1ba3-2f43-4ab6-bb78-9878a9aae0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:20.496153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9cd1e-1f78-4afe-a0b4-b5bf23e83e23 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.501214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.502504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.502504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.503369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] PATH_INFO: `/v3/projects/58fad437f1e7473da12fa3fb143834c1` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.504041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=58fad437f1e7473da12fa3fb143834c1)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.506205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:20.546355 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df1ba3-2f43-4ab6-bb78-9878a9aae0cc None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.558976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58fad437f1e7473da12fa3fb143834c1', 'request_id': 'req-f8183bf2-4d82-476a-99a0-76840bd94dfa'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.568728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58fad437f1e7473da12fa3fb143834c1', 'request_id': 'req-f8183bf2-4d82-476a-99a0-76840bd94dfa'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.576823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58fad437f1e7473da12fa3fb143834c1', 'request_id': 'req-f8183bf2-4d82-476a-99a0-76840bd94dfa'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.589667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] The token cache is being invalidate because project 58fad437f1e7473da12fa3fb143834c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:20.589959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.590631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.592673 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1092/2177] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:20 2022] DELETE /identity/v3/projects/58fad437f1e7473da12fa3fb143834c1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:20.594648 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:20.596471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:20.597969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:20.609198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430db4fc-358d-49b1-9f64-697144ae0e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.609951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430db4fc-358d-49b1-9f64-697144ae0e58 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.610280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430db4fc-358d-49b1-9f64-697144ae0e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.610593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430db4fc-358d-49b1-9f64-697144ae0e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.612444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-430db4fc-358d-49b1-9f64-697144ae0e58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:20.664329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:20.668995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8183bf2-4d82-476a-99a0-76840bd94dfa admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.675806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02caa1b2-fb2b-481a-80f0-1e56d28d8596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.677453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caa1b2-fb2b-481a-80f0-1e56d28d8596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.677967 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caa1b2-fb2b-481a-80f0-1e56d28d8596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.678344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430db4fc-358d-49b1-9f64-697144ae0e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.678467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caa1b2-fb2b-481a-80f0-1e56d28d8596 admin admin] PATH_INFO: `/v3/users/1b49f1e3695b44f9aee225baff765aaa` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.679640 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02caa1b2-fb2b-481a-80f0-1e56d28d8596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b49f1e3695b44f9aee225baff765aaa)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.679791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430db4fc-358d-49b1-9f64-697144ae0e58 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:20.682191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02caa1b2-fb2b-481a-80f0-1e56d28d8596 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:20.690907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1086/2178] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:26:20.736752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-02caa1b2-fb2b-481a-80f0-1e56d28d8596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b49f1e3695b44f9aee225baff765aaa'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.737427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-02caa1b2-fb2b-481a-80f0-1e56d28d8596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b49f1e3695b44f9aee225baff765aaa'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.751528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-02caa1b2-fb2b-481a-80f0-1e56d28d8596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b49f1e3695b44f9aee225baff765aaa'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.752483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-02caa1b2-fb2b-481a-80f0-1e56d28d8596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b49f1e3695b44f9aee225baff765aaa'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.768166 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-02caa1b2-fb2b-481a-80f0-1e56d28d8596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b49f1e3695b44f9aee225baff765aaa'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.790699 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1093/2179] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:20 2022] DELETE /identity/v3/users/1b49f1e3695b44f9aee225baff765aaa => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:20.843421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430db4fc-358d-49b1-9f64-697144ae0e58 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:20.845274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-430db4fc-358d-49b1-9f64-697144ae0e58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:20.859742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430db4fc-358d-49b1-9f64-697144ae0e58 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.940290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.941304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.942011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.942390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] PATH_INFO: `/v3/users/8cd6fb0ab6db4f4ebb24985d847fc5e6` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.943831 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd6fb0ab6db4f4ebb24985d847fc5e6)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.945964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.046695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd6fb0ab6db4f4ebb24985d847fc5e6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.063554 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd6fb0ab6db4f4ebb24985d847fc5e6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.064344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd6fb0ab6db4f4ebb24985d847fc5e6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.074961 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd6fb0ab6db4f4ebb24985d847fc5e6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.082789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd6fb0ab6db4f4ebb24985d847fc5e6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.092857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1087/2180] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:20 2022] DELETE /identity/v3/users/8cd6fb0ab6db4f4ebb24985d847fc5e6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:21.095058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450037fd-0c65-4972-b1ac-611e635773e7 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.095446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450037fd-0c65-4972-b1ac-611e635773e7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.095798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450037fd-0c65-4972-b1ac-611e635773e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.121716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-450037fd-0c65-4972-b1ac-611e635773e7 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:21.123035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-450037fd-0c65-4972-b1ac-611e635773e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.179942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.182722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.198780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:21.202849 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1094/2181] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:21.215034 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450037fd-0c65-4972-b1ac-611e635773e7 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.216565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-450037fd-0c65-4972-b1ac-611e635773e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.258110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d388868-42de-46d4-aa52-6552a91daac3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.262873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.263732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.264046 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.264332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] PATH_INFO: `/v3/projects/27c644023671427b9456b2ed15013d77` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.265521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c644023671427b9456b2ed15013d77)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.267429 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.274954 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450037fd-0c65-4972-b1ac-611e635773e7 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.278602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acab8f8-6ece-49ea-b485-5cc27101c2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.279248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab8f8-6ece-49ea-b485-5cc27101c2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.279543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab8f8-6ece-49ea-b485-5cc27101c2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.279824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab8f8-6ece-49ea-b485-5cc27101c2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.289340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acab8f8-6ece-49ea-b485-5cc27101c2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.291287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acab8f8-6ece-49ea-b485-5cc27101c2f9 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.301507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1095/2182] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:26:21.315558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c644023671427b9456b2ed15013d77', 'request_id': 'req-a0e64112-8505-40e7-a346-aac61e975f5f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.323504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c644023671427b9456b2ed15013d77', 'request_id': 'req-a0e64112-8505-40e7-a346-aac61e975f5f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.329631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c644023671427b9456b2ed15013d77', 'request_id': 'req-a0e64112-8505-40e7-a346-aac61e975f5f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.342587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] The token cache is being invalidate because project 27c644023671427b9456b2ed15013d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:21.342881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.343550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a0e64112-8505-40e7-a346-aac61e975f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.345143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1088/2183] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:21 2022] DELETE /identity/v3/projects/27c644023671427b9456b2ed15013d77 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:21.350276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd9b79-ad0f-49d0-b293-6c271b8debc5 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.350978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd9b79-ad0f-49d0-b293-6c271b8debc5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.351464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd9b79-ad0f-49d0-b293-6c271b8debc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.370111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-78bd9b79-ad0f-49d0-b293-6c271b8debc5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:21.371436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-78bd9b79-ad0f-49d0-b293-6c271b8debc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.385388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:21.437659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1096/2184] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:21.446740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57c1f-f982-4cc9-b03b-b6d444d1c452 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.447043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57c1f-f982-4cc9-b03b-b6d444d1c452 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.447323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa57c1f-f982-4cc9-b03b-b6d444d1c452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.466361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7fa57c1f-f982-4cc9-b03b-b6d444d1c452 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:21.467497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7fa57c1f-f982-4cc9-b03b-b6d444d1c452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.475610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1089/2185] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:21.480130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd9b79-ad0f-49d0-b293-6c271b8debc5 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.489832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd9b79-ad0f-49d0-b293-6c271b8debc5 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.495298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6248ca-f663-45ef-9ab5-829620ba212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.495983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6248ca-f663-45ef-9ab5-829620ba212d admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.496281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6248ca-f663-45ef-9ab5-829620ba212d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.496580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6248ca-f663-45ef-9ab5-829620ba212d admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.497294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6248ca-f663-45ef-9ab5-829620ba212d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:21.497611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6248ca-f663-45ef-9ab5-829620ba212d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.499223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6248ca-f663-45ef-9ab5-829620ba212d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.511686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1097/2186] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:26:21.516404 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa57c1f-f982-4cc9-b03b-b6d444d1c452 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.526885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa57c1f-f982-4cc9-b03b-b6d444d1c452 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.531762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731883b-679a-4fc6-9b44-8a6592073d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.532568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731883b-679a-4fc6-9b44-8a6592073d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.532850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731883b-679a-4fc6-9b44-8a6592073d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.533129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731883b-679a-4fc6-9b44-8a6592073d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.533952 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731883b-679a-4fc6-9b44-8a6592073d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.535870 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731883b-679a-4fc6-9b44-8a6592073d27 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.564678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1090/2187] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:21 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:21.569739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6248ca-f663-45ef-9ab5-829620ba212d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.581313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6248ca-f663-45ef-9ab5-829620ba212d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.582836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731883b-679a-4fc6-9b44-8a6592073d27 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.584629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b731883b-679a-4fc6-9b44-8a6592073d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.645887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d947bc8-c831-45ba-94ae-93b22aca5f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.646563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d947bc8-c831-45ba-94ae-93b22aca5f32 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.646850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d947bc8-c831-45ba-94ae-93b22aca5f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.647128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d947bc8-c831-45ba-94ae-93b22aca5f32 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.647870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d947bc8-c831-45ba-94ae-93b22aca5f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.649960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d947bc8-c831-45ba-94ae-93b22aca5f32 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.655049 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731883b-679a-4fc6-9b44-8a6592073d27 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.659735 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.660624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.660921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.661180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] PATH_INFO: `/v3/projects/2b26f364db9941b6bfc1128a27d325f2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.662563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b26f364db9941b6bfc1128a27d325f2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.664626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.670147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1098/2188] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:21 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:21.674394 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d947bc8-c831-45ba-94ae-93b22aca5f32 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.681225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:21.684927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d947bc8-c831-45ba-94ae-93b22aca5f32 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.689875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8481b7-9d1a-4c00-a4a2-40fc33e1ae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.690560 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8481b7-9d1a-4c00-a4a2-40fc33e1ae78 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.690813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8481b7-9d1a-4c00-a4a2-40fc33e1ae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.691177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8481b7-9d1a-4c00-a4a2-40fc33e1ae78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.691983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8481b7-9d1a-4c00-a4a2-40fc33e1ae78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.693779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8481b7-9d1a-4c00-a4a2-40fc33e1ae78 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.704814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1099/2189] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:21.708733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8481b7-9d1a-4c00-a4a2-40fc33e1ae78 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.718762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8481b7-9d1a-4c00-a4a2-40fc33e1ae78 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.719056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b26f364db9941b6bfc1128a27d325f2', 'request_id': 'req-91cadfcb-d304-4728-afb5-7974e1ba9b07'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.726960 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b26f364db9941b6bfc1128a27d325f2', 'request_id': 'req-91cadfcb-d304-4728-afb5-7974e1ba9b07'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.733383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b26f364db9941b6bfc1128a27d325f2', 'request_id': 'req-91cadfcb-d304-4728-afb5-7974e1ba9b07'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.744985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] The token cache is being invalidate because project 2b26f364db9941b6bfc1128a27d325f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:21.745271 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.745953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.747569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1091/2190] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:21 2022] DELETE /identity/v3/projects/2b26f364db9941b6bfc1128a27d325f2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:21.751300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.752618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.777299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f9f26-012e-4a65-afc8-cc3d236b6640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.777974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f9f26-012e-4a65-afc8-cc3d236b6640 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.778366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f9f26-012e-4a65-afc8-cc3d236b6640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.778658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f9f26-012e-4a65-afc8-cc3d236b6640 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.779386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f9f26-012e-4a65-afc8-cc3d236b6640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.781018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f9f26-012e-4a65-afc8-cc3d236b6640 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.794040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1100/2191] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:21.795045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f9f26-012e-4a65-afc8-cc3d236b6640 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.796799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-dc1f9f26-012e-4a65-afc8-cc3d236b6640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.809796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f9f26-012e-4a65-afc8-cc3d236b6640 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.815093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d97bd8-cbf4-4114-be59-b9d21e3896d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.815605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cadfcb-d304-4728-afb5-7974e1ba9b07 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.816005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97bd8-cbf4-4114-be59-b9d21e3896d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.816301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97bd8-cbf4-4114-be59-b9d21e3896d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.816609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97bd8-cbf4-4114-be59-b9d21e3896d6 admin admin] PATH_INFO: `/v3/projects/01eeccb088fb43dc9099d3109d9e20a4/users/345e9779a6a340bba9ae476957b5e2de/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.820327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.821716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.822004 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.822296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] PATH_INFO: `/v3/users/f1c2c01530994f80b6cb0675d06201c3` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.823498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c2c01530994f80b6cb0675d06201c3)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.826036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.832015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d97bd8-cbf4-4114-be59-b9d21e3896d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01eeccb088fb43dc9099d3109d9e20a4, user_id=345e9779a6a340bba9ae476957b5e2de, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.834662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d97bd8-cbf4-4114-be59-b9d21e3896d6 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.843374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:21.850909 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1101/2192] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:21 2022] PUT /identity/v3/projects/01eeccb088fb43dc9099d3109d9e20a4/users/345e9779a6a340bba9ae476957b5e2de/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:21.863348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042013e-8b46-4725-b967-67fe0a5eeea5 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.863648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042013e-8b46-4725-b967-67fe0a5eeea5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.863939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042013e-8b46-4725-b967-67fe0a5eeea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.881606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c2c01530994f80b6cb0675d06201c3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.893250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c042013e-8b46-4725-b967-67fe0a5eeea5 None None] MFA Rules not processed for user `345e9779a6a340bba9ae476957b5e2de`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:21.894355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c042013e-8b46-4725-b967-67fe0a5eeea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.894913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c2c01530994f80b6cb0675d06201c3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.895610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c2c01530994f80b6cb0675d06201c3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.904651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c2c01530994f80b6cb0675d06201c3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.911501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c2c01530994f80b6cb0675d06201c3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.918277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1092/2193] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:21 2022] DELETE /identity/v3/users/f1c2c01530994f80b6cb0675d06201c3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:21.960525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1102/2194] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:21.973538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.975007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:22.003518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:22.047213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98134cb3-f4d8-4939-b313-05a2dc6ce661 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.051124 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c93f7a-2098-4446-9152-bb1073d4ea4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.051774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93f7a-2098-4446-9152-bb1073d4ea4b service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.052085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93f7a-2098-4446-9152-bb1073d4ea4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.052365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c93f7a-2098-4446-9152-bb1073d4ea4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.139850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c93f7a-2098-4446-9152-bb1073d4ea4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:22.141362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c93f7a-2098-4446-9152-bb1073d4ea4b service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.151252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1093/2195] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:22.226097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042013e-8b46-4725-b967-67fe0a5eeea5 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:22.227665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c042013e-8b46-4725-b967-67fe0a5eeea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:22.349778 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042013e-8b46-4725-b967-67fe0a5eeea5 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.409782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.410649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.410926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.411198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] PATH_INFO: `/v3/projects/6463455eae2b4292b24645d69b5288bd` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.412511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6463455eae2b4292b24645d69b5288bd)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:22.414414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.457631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:22.475883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6463455eae2b4292b24645d69b5288bd', 'request_id': 'req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:22.486518 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6463455eae2b4292b24645d69b5288bd', 'request_id': 'req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:22.493746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6463455eae2b4292b24645d69b5288bd', 'request_id': 'req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:22.505204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] The token cache is being invalidate because project 6463455eae2b4292b24645d69b5288bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:22.505500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:22.506157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9a2c2d60-9b83-423e-9e7f-6391a7bcabb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:22.507789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1103/2196] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:22 2022] DELETE /identity/v3/projects/6463455eae2b4292b24645d69b5288bd => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:22.512708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5669c59-4dd9-4942-bea7-889f1b2a2ea4 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.513176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5669c59-4dd9-4942-bea7-889f1b2a2ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.513266 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5669c59-4dd9-4942-bea7-889f1b2a2ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.531785 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-b5669c59-4dd9-4942-bea7-889f1b2a2ea4 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:22.533040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b5669c59-4dd9-4942-bea7-889f1b2a2ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:22.593804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1094/2197] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:22.601610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d288-1aff-42fc-92b6-700a12ad4174 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.602069 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d288-1aff-42fc-92b6-700a12ad4174 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.602159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d288-1aff-42fc-92b6-700a12ad4174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.621667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c969d288-1aff-42fc-92b6-700a12ad4174 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:22.622870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c969d288-1aff-42fc-92b6-700a12ad4174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:22.630684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1104/2198] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:22.634955 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5669c59-4dd9-4942-bea7-889f1b2a2ea4 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:22.644505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5669c59-4dd9-4942-bea7-889f1b2a2ea4 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.649034 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f8dd4-32ae-48d8-834d-4c1c08b6820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.649711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f8dd4-32ae-48d8-834d-4c1c08b6820e admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.649999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f8dd4-32ae-48d8-834d-4c1c08b6820e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.650278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f8dd4-32ae-48d8-834d-4c1c08b6820e admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.651031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f8dd4-32ae-48d8-834d-4c1c08b6820e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:22.651342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f8dd4-32ae-48d8-834d-4c1c08b6820e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:22.652974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f8dd4-32ae-48d8-834d-4c1c08b6820e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.664536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1095/2199] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:22.669178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d288-1aff-42fc-92b6-700a12ad4174 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:22.678164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d288-1aff-42fc-92b6-700a12ad4174 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.683402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869bbc2-097e-44af-807b-10a45bfd2fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.684079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869bbc2-097e-44af-807b-10a45bfd2fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.684369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869bbc2-097e-44af-807b-10a45bfd2fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.684654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869bbc2-097e-44af-807b-10a45bfd2fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.685341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869bbc2-097e-44af-807b-10a45bfd2fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:22.687226 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869bbc2-097e-44af-807b-10a45bfd2fcd admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.713026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1105/2200] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:22 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:22.717278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f8dd4-32ae-48d8-834d-4c1c08b6820e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:22.728438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f8dd4-32ae-48d8-834d-4c1c08b6820e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.787461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43a2b5-7aa7-4537-8155-4acb057e49b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.789199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43a2b5-7aa7-4537-8155-4acb057e49b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.789199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43a2b5-7aa7-4537-8155-4acb057e49b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.789199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43a2b5-7aa7-4537-8155-4acb057e49b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.790382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43a2b5-7aa7-4537-8155-4acb057e49b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:22.792439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43a2b5-7aa7-4537-8155-4acb057e49b8 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.801495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:22.815520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1096/2201] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:22 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:22.819651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869bbc2-097e-44af-807b-10a45bfd2fcd admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:22.830792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869bbc2-097e-44af-807b-10a45bfd2fcd admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.835703 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653702-990f-4a26-9d7a-e09ab18ea813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.836415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653702-990f-4a26-9d7a-e09ab18ea813 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.837198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653702-990f-4a26-9d7a-e09ab18ea813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.837621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03653702-990f-4a26-9d7a-e09ab18ea813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.838354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03653702-990f-4a26-9d7a-e09ab18ea813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:22.839980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03653702-990f-4a26-9d7a-e09ab18ea813 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.850649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1106/2202] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:22.855329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43a2b5-7aa7-4537-8155-4acb057e49b8 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:22.865961 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43a2b5-7aa7-4537-8155-4acb057e49b8 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.871487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c46a9-2173-4245-b4c1-705d7883c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.872419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c46a9-2173-4245-b4c1-705d7883c7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.872733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c46a9-2173-4245-b4c1-705d7883c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.873074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c46a9-2173-4245-b4c1-705d7883c7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.874054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c46a9-2173-4245-b4c1-705d7883c7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:22.875835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c46a9-2173-4245-b4c1-705d7883c7c8 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.891361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1097/2203] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:22.892621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653702-990f-4a26-9d7a-e09ab18ea813 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:22.903340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03653702-990f-4a26-9d7a-e09ab18ea813 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.908488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa3878-cff1-44fc-857f-c00259eea961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.909376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa3878-cff1-44fc-857f-c00259eea961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.909663 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa3878-cff1-44fc-857f-c00259eea961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.909942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa3878-cff1-44fc-857f-c00259eea961 admin admin] PATH_INFO: `/v3/projects/3e62aef4fc654fabbe003c2f729cb355/users/2d585b0ac8894b748a906f6b7e4beba1/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.924970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa3878-cff1-44fc-857f-c00259eea961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e62aef4fc654fabbe003c2f729cb355, user_id=2d585b0ac8894b748a906f6b7e4beba1, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:22.927625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa3878-cff1-44fc-857f-c00259eea961 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.940859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1107/2204] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:22 2022] PUT /identity/v3/projects/3e62aef4fc654fabbe003c2f729cb355/users/2d585b0ac8894b748a906f6b7e4beba1/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:22.952205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08029d2-5018-4d20-b780-a59a7ec9c914 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.952506 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08029d2-5018-4d20-b780-a59a7ec9c914 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.952798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08029d2-5018-4d20-b780-a59a7ec9c914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.981884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-c08029d2-5018-4d20-b780-a59a7ec9c914 None None] MFA Rules not processed for user `2d585b0ac8894b748a906f6b7e4beba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:22.983097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c08029d2-5018-4d20-b780-a59a7ec9c914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:23.050089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1098/2205] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:23.054691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa3878-cff1-44fc-857f-c00259eea961 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:23.118856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa3878-cff1-44fc-857f-c00259eea961 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:23.123681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea669d96-bddd-4dae-9310-4585d30ed756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:23.124371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669d96-bddd-4dae-9310-4585d30ed756 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.124661 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669d96-bddd-4dae-9310-4585d30ed756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.124944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea669d96-bddd-4dae-9310-4585d30ed756 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.125685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea669d96-bddd-4dae-9310-4585d30ed756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.127610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea669d96-bddd-4dae-9310-4585d30ed756 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.163981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1108/2206] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:23 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:23.168386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08029d2-5018-4d20-b780-a59a7ec9c914 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:23.179055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08029d2-5018-4d20-b780-a59a7ec9c914 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:23.251428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5da35-5ddc-4793-8ba2-9311e51e911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:23.252147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5da35-5ddc-4793-8ba2-9311e51e911b admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.252436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5da35-5ddc-4793-8ba2-9311e51e911b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.252716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5da35-5ddc-4793-8ba2-9311e51e911b admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.253411 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5da35-5ddc-4793-8ba2-9311e51e911b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.255440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5da35-5ddc-4793-8ba2-9311e51e911b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.281504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1099/2207] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:23 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:23.285264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea669d96-bddd-4dae-9310-4585d30ed756 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:23.296638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea669d96-bddd-4dae-9310-4585d30ed756 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:23.301883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17884eab-a2b4-4206-af4d-2c1729f360f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:23.302648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17884eab-a2b4-4206-af4d-2c1729f360f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.303014 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17884eab-a2b4-4206-af4d-2c1729f360f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.303381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17884eab-a2b4-4206-af4d-2c1729f360f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.304220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17884eab-a2b4-4206-af4d-2c1729f360f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.306097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17884eab-a2b4-4206-af4d-2c1729f360f1 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.323105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1109/2208] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:23.326886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5da35-5ddc-4793-8ba2-9311e51e911b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:23.337604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5da35-5ddc-4793-8ba2-9311e51e911b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:23.342393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38230abe-5a74-4852-b05b-3c30402b66bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:23.343455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38230abe-5a74-4852-b05b-3c30402b66bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.343577 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38230abe-5a74-4852-b05b-3c30402b66bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.343837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38230abe-5a74-4852-b05b-3c30402b66bb admin admin] PATH_INFO: `/v3/projects/bd77a69188644ffbbd4afe3734d3c7b4/users/f55804626e004226a23759e6a28e5a07/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.360029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38230abe-5a74-4852-b05b-3c30402b66bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd77a69188644ffbbd4afe3734d3c7b4, user_id=f55804626e004226a23759e6a28e5a07, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.362683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38230abe-5a74-4852-b05b-3c30402b66bb admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.384061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1100/2209] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:23 2022] PUT /identity/v3/projects/bd77a69188644ffbbd4afe3734d3c7b4/users/f55804626e004226a23759e6a28e5a07/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:23.385628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17884eab-a2b4-4206-af4d-2c1729f360f1 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:23.397253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17884eab-a2b4-4206-af4d-2c1729f360f1 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:23.430505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:23.456752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8b3a6-201b-42ff-8b29-cdf42376a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:23.457458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8b3a6-201b-42ff-8b29-cdf42376a663 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.457900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8b3a6-201b-42ff-8b29-cdf42376a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.458209 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8b3a6-201b-42ff-8b29-cdf42376a663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.458974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8b3a6-201b-42ff-8b29-cdf42376a663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.460637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8b3a6-201b-42ff-8b29-cdf42376a663 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.471612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1110/2210] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:23.475919 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38230abe-5a74-4852-b05b-3c30402b66bb admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:23.491799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38230abe-5a74-4852-b05b-3c30402b66bb admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:23.491799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197dd78-e41f-4e13-8e9a-bc82d164cfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:23.492475 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197dd78-e41f-4e13-8e9a-bc82d164cfc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.492757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197dd78-e41f-4e13-8e9a-bc82d164cfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.493074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197dd78-e41f-4e13-8e9a-bc82d164cfc4 admin admin] PATH_INFO: `/v3/projects/bd77a69188644ffbbd4afe3734d3c7b4/users/f55804626e004226a23759e6a28e5a07/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.495049 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197dd78-e41f-4e13-8e9a-bc82d164cfc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd77a69188644ffbbd4afe3734d3c7b4, user_id=f55804626e004226a23759e6a28e5a07, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.497783 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197dd78-e41f-4e13-8e9a-bc82d164cfc4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.509171 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1101/2211] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:23 2022] PUT /identity/v3/projects/bd77a69188644ffbbd4afe3734d3c7b4/users/f55804626e004226a23759e6a28e5a07/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:23.519066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949b774-68de-408f-8bd7-522ffc09865a None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.519380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949b774-68de-408f-8bd7-522ffc09865a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.519658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949b774-68de-408f-8bd7-522ffc09865a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.546542 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f949b774-68de-408f-8bd7-522ffc09865a None None] MFA Rules not processed for user `f55804626e004226a23759e6a28e5a07`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:23.547751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f949b774-68de-408f-8bd7-522ffc09865a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:23.620445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1111/2212] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:23.634532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197dd78-e41f-4e13-8e9a-bc82d164cfc4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:23.636468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b197dd78-e41f-4e13-8e9a-bc82d164cfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:23.667627 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:23.717465 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197dd78-e41f-4e13-8e9a-bc82d164cfc4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:23.721377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fae05b-72e4-4d92-8e98-97b196e422c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:23.722157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae05b-72e4-4d92-8e98-97b196e422c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.724119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae05b-72e4-4d92-8e98-97b196e422c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.724119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae05b-72e4-4d92-8e98-97b196e422c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.734217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fae05b-72e4-4d92-8e98-97b196e422c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.736155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fae05b-72e4-4d92-8e98-97b196e422c8 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.747374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1102/2213] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:24.140222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949b774-68de-408f-8bd7-522ffc09865a None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:24.200424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949b774-68de-408f-8bd7-522ffc09865a None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:24.204930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:24.205800 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:24.206085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:24.206366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] PATH_INFO: `/v3/users/2d585b0ac8894b748a906f6b7e4beba1` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:24.207548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d585b0ac8894b748a906f6b7e4beba1)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:24.209499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:24.253693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d585b0ac8894b748a906f6b7e4beba1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:24.254345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d585b0ac8894b748a906f6b7e4beba1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:24.261916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:24.266639 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d585b0ac8894b748a906f6b7e4beba1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:24.267277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d585b0ac8894b748a906f6b7e4beba1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:24.274845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d585b0ac8894b748a906f6b7e4beba1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:24.286779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1112/2214] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:24 2022] DELETE /identity/v3/users/2d585b0ac8894b748a906f6b7e4beba1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:24.291846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004bc7-c99b-449f-bb81-5cbc490a3831 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:24.292116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004bc7-c99b-449f-bb81-5cbc490a3831 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:24.292400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004bc7-c99b-449f-bb81-5cbc490a3831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:24.310526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-1d004bc7-c99b-449f-bb81-5cbc490a3831 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:24.311717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-1d004bc7-c99b-449f-bb81-5cbc490a3831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:24.371396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1103/2215] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:24.381050 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:24.382458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:24.440603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0923f-1d62-41a7-8745-c8731079f08b admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:24.444272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f114465-688a-4eb4-b924-c6eecaa258e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:24.444916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f114465-688a-4eb4-b924-c6eecaa258e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:24.445199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f114465-688a-4eb4-b924-c6eecaa258e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:24.445477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f114465-688a-4eb4-b924-c6eecaa258e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:24.454848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f114465-688a-4eb4-b924-c6eecaa258e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:24.456299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f114465-688a-4eb4-b924-c6eecaa258e4 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:24.467750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1113/2216] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:26:24.540551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0591e-2fb2-48a2-97d1-e1c92090b422 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:24.540938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0591e-2fb2-48a2-97d1-e1c92090b422 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:24.541289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0591e-2fb2-48a2-97d1-e1c92090b422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:24.558808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-45e0591e-2fb2-48a2-97d1-e1c92090b422 None None] MFA Rules not processed for user `46d57f08982847ff9771802e3cbd4297`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:24.560087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-45e0591e-2fb2-48a2-97d1-e1c92090b422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:24.620602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1104/2217] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:24.828932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f114465-688a-4eb4-b924-c6eecaa258e4 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:24.830534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3f114465-688a-4eb4-b924-c6eecaa258e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:24.844501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f114465-688a-4eb4-b924-c6eecaa258e4 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:24.849434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:24.850302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:24.850582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:24.850855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] PATH_INFO: `/v3/projects/3e62aef4fc654fabbe003c2f729cb355` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:24.852111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e62aef4fc654fabbe003c2f729cb355)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:24.855291 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:24.921405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e62aef4fc654fabbe003c2f729cb355', 'request_id': 'req-58f21403-179d-41e4-b276-d8c5ab5dd336'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:24.928946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e62aef4fc654fabbe003c2f729cb355', 'request_id': 'req-58f21403-179d-41e4-b276-d8c5ab5dd336'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:24.936153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e62aef4fc654fabbe003c2f729cb355', 'request_id': 'req-58f21403-179d-41e4-b276-d8c5ab5dd336'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:24.950107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] The token cache is being invalidate because project 3e62aef4fc654fabbe003c2f729cb355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:24.950554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:24.952651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:24.955207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1114/2218] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:24 2022] DELETE /identity/v3/projects/3e62aef4fc654fabbe003c2f729cb355 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:24.961236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0591e-2fb2-48a2-97d1-e1c92090b422 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:24.981974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0591e-2fb2-48a2-97d1-e1c92090b422 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:25.060743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da033a9a-83f4-44c5-a2c5-b7051a9d091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:25.061551 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033a9a-83f4-44c5-a2c5-b7051a9d091c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.061904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033a9a-83f4-44c5-a2c5-b7051a9d091c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.062523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033a9a-83f4-44c5-a2c5-b7051a9d091c admin admin] PATH_INFO: `/v3/users/f55804626e004226a23759e6a28e5a07` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.063762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da033a9a-83f4-44c5-a2c5-b7051a9d091c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55804626e004226a23759e6a28e5a07)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:25.065796 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da033a9a-83f4-44c5-a2c5-b7051a9d091c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:25.079844 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:25.118302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-da033a9a-83f4-44c5-a2c5-b7051a9d091c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55804626e004226a23759e6a28e5a07'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:25.132683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-da033a9a-83f4-44c5-a2c5-b7051a9d091c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55804626e004226a23759e6a28e5a07'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:25.134064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-da033a9a-83f4-44c5-a2c5-b7051a9d091c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55804626e004226a23759e6a28e5a07'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:25.143661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-da033a9a-83f4-44c5-a2c5-b7051a9d091c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55804626e004226a23759e6a28e5a07'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:25.152701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-da033a9a-83f4-44c5-a2c5-b7051a9d091c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55804626e004226a23759e6a28e5a07'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:25.159210 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1105/2219] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:24 2022] DELETE /identity/v3/users/f55804626e004226a23759e6a28e5a07 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:25.477998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:25.479892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:25.496629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f21403-179d-41e4-b276-d8c5ab5dd336 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:25.562312 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:25.563143 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.563432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.563789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] PATH_INFO: `/v3/projects/bd77a69188644ffbbd4afe3734d3c7b4` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.564927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd77a69188644ffbbd4afe3734d3c7b4)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:25.566843 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:25.569164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:25.629259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd77a69188644ffbbd4afe3734d3c7b4', 'request_id': 'req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:25.637414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd77a69188644ffbbd4afe3734d3c7b4', 'request_id': 'req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:25.647593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd77a69188644ffbbd4afe3734d3c7b4', 'request_id': 'req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:25.660172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] The token cache is being invalidate because project bd77a69188644ffbbd4afe3734d3c7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:25.660538 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:25.661234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1ebc8b04-283f-433c-bd1c-a7f7a53c119f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:25.662895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1115/2220] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:25 2022] DELETE /identity/v3/projects/bd77a69188644ffbbd4afe3734d3c7b4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:25.668484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c6efb-4da3-4e5f-b0a5-b1be786564f6 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.668782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c6efb-4da3-4e5f-b0a5-b1be786564f6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.669066 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c6efb-4da3-4e5f-b0a5-b1be786564f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.688313 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-443c6efb-4da3-4e5f-b0a5-b1be786564f6 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:25.689601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-443c6efb-4da3-4e5f-b0a5-b1be786564f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:25.760773 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1106/2221] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:25.769698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d17ff-44b0-4ed7-a37a-76615caa3a30 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.770061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d17ff-44b0-4ed7-a37a-76615caa3a30 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.770408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d17ff-44b0-4ed7-a37a-76615caa3a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.791383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-d21d17ff-44b0-4ed7-a37a-76615caa3a30 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:25.792694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d21d17ff-44b0-4ed7-a37a-76615caa3a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:25.801263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1116/2222] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:25.805985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c6efb-4da3-4e5f-b0a5-b1be786564f6 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:25.815598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c6efb-4da3-4e5f-b0a5-b1be786564f6 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:25.820488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fcf6a-02e5-4a97-9e02-86be4b02aa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:25.821258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fcf6a-02e5-4a97-9e02-86be4b02aa38 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.821606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fcf6a-02e5-4a97-9e02-86be4b02aa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.821890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fcf6a-02e5-4a97-9e02-86be4b02aa38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.822618 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fcf6a-02e5-4a97-9e02-86be4b02aa38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:25.822932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fcf6a-02e5-4a97-9e02-86be4b02aa38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:25.824857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fcf6a-02e5-4a97-9e02-86be4b02aa38 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:25.840985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1107/2223] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:26:25.842049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d17ff-44b0-4ed7-a37a-76615caa3a30 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:25.851500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d17ff-44b0-4ed7-a37a-76615caa3a30 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:25.857418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27977d15-528a-4b75-a108-ef274a6977d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:25.858081 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27977d15-528a-4b75-a108-ef274a6977d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.858367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27977d15-528a-4b75-a108-ef274a6977d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.858643 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27977d15-528a-4b75-a108-ef274a6977d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.859341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27977d15-528a-4b75-a108-ef274a6977d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:25.861284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27977d15-528a-4b75-a108-ef274a6977d4 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:25.891350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1117/2224] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:25 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:25.892490 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fcf6a-02e5-4a97-9e02-86be4b02aa38 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:25.903259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fcf6a-02e5-4a97-9e02-86be4b02aa38 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:25.957917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ac5b6-1678-4ebc-83ff-e0745c2be07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:25.958582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ac5b6-1678-4ebc-83ff-e0745c2be07f admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.958869 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ac5b6-1678-4ebc-83ff-e0745c2be07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.959148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ac5b6-1678-4ebc-83ff-e0745c2be07f admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.959843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ac5b6-1678-4ebc-83ff-e0745c2be07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:25.962315 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ac5b6-1678-4ebc-83ff-e0745c2be07f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:25.982104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1108/2225] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:25 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:25.986305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27977d15-528a-4b75-a108-ef274a6977d4 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:25.997096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27977d15-528a-4b75-a108-ef274a6977d4 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:26.002081 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2de8b-579d-4b6f-88dc-eb42bdf15747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:26.002756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2de8b-579d-4b6f-88dc-eb42bdf15747 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:26.003043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2de8b-579d-4b6f-88dc-eb42bdf15747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:26.003381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2de8b-579d-4b6f-88dc-eb42bdf15747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:26.004075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2de8b-579d-4b6f-88dc-eb42bdf15747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:26.005690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2de8b-579d-4b6f-88dc-eb42bdf15747 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:26.019990 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1118/2226] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:26.025085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ac5b6-1678-4ebc-83ff-e0745c2be07f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:26.040863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ac5b6-1678-4ebc-83ff-e0745c2be07f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:26.045602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2abe-b4c6-4ce7-b859-beabdced51c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:26.046280 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2abe-b4c6-4ce7-b859-beabdced51c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:26.046570 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2abe-b4c6-4ce7-b859-beabdced51c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:26.046881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2abe-b4c6-4ce7-b859-beabdced51c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:26.047599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d2abe-b4c6-4ce7-b859-beabdced51c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:26.049228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d2abe-b4c6-4ce7-b859-beabdced51c0 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:26.051492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:26.063230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1109/2227] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:26.067102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2de8b-579d-4b6f-88dc-eb42bdf15747 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:26.077195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2de8b-579d-4b6f-88dc-eb42bdf15747 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:26.081902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369f279-ccb5-443e-9185-5a1ed67091d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:26.082828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369f279-ccb5-443e-9185-5a1ed67091d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:26.083408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369f279-ccb5-443e-9185-5a1ed67091d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:26.083408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369f279-ccb5-443e-9185-5a1ed67091d3 admin admin] PATH_INFO: `/v3/projects/62c3bc9dcafa436c8ea4dd5b5d6a69af/users/d9622a71a79244aa8d9d0eff6a23258c/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:26.100503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369f279-ccb5-443e-9185-5a1ed67091d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c3bc9dcafa436c8ea4dd5b5d6a69af, user_id=d9622a71a79244aa8d9d0eff6a23258c, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:26.103834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369f279-ccb5-443e-9185-5a1ed67091d3 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:26.118786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1119/2228] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:26 2022] PUT /identity/v3/projects/62c3bc9dcafa436c8ea4dd5b5d6a69af/users/d9622a71a79244aa8d9d0eff6a23258c/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:26.129083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419b4a-37a5-494c-9889-b9882253a95c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:26.129380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419b4a-37a5-494c-9889-b9882253a95c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:26.130010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78419b4a-37a5-494c-9889-b9882253a95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:26.168114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-78419b4a-37a5-494c-9889-b9882253a95c None None] MFA Rules not processed for user `d9622a71a79244aa8d9d0eff6a23258c`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:26.169333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-78419b4a-37a5-494c-9889-b9882253a95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:26.244667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1110/2229] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:26.256421 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369f279-ccb5-443e-9185-5a1ed67091d3 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:26.260212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e369f279-ccb5-443e-9185-5a1ed67091d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:26.365123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369f279-ccb5-443e-9185-5a1ed67091d3 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:26.369010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cbcab-9930-46d3-90a7-6c16a6eaf98d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:26.369663 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cbcab-9930-46d3-90a7-6c16a6eaf98d service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:26.369952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cbcab-9930-46d3-90a7-6c16a6eaf98d service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:26.370496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cbcab-9930-46d3-90a7-6c16a6eaf98d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:26.379782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cbcab-9930-46d3-90a7-6c16a6eaf98d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:26.381786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cbcab-9930-46d3-90a7-6c16a6eaf98d service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:26.412835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1120/2230] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:26:26.416670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78419b4a-37a5-494c-9889-b9882253a95c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:26.492877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78419b4a-37a5-494c-9889-b9882253a95c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:26.497411 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:26.498299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:26.498583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:26.498962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] PATH_INFO: `/v3/users/d9622a71a79244aa8d9d0eff6a23258c` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:26.500231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9622a71a79244aa8d9d0eff6a23258c)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:26.502153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:26.552226 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9622a71a79244aa8d9d0eff6a23258c'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:26.564061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9622a71a79244aa8d9d0eff6a23258c'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:26.564765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9622a71a79244aa8d9d0eff6a23258c'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:26.573087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9622a71a79244aa8d9d0eff6a23258c'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:26.580649 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9622a71a79244aa8d9d0eff6a23258c'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:26.587771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1111/2231] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:26 2022] DELETE /identity/v3/users/d9622a71a79244aa8d9d0eff6a23258c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:26.592655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a943ee-c136-468d-be42-f8bb6996b1b6 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:26.592995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a943ee-c136-468d-be42-f8bb6996b1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:26.593247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a943ee-c136-468d-be42-f8bb6996b1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:26.614359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-77a943ee-c136-468d-be42-f8bb6996b1b6 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:26.615632 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-77a943ee-c136-468d-be42-f8bb6996b1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:26.646611 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:26.682837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1121/2232] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:26.692909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:26.694463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:26.705636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:26.755080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248645a-280d-4a7c-a7ef-c0f8164f3bf0 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:26.759290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c7354-174a-46e6-88a1-5ebaeed2ad0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:26.759942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c7354-174a-46e6-88a1-5ebaeed2ad0c service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:26.760254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c7354-174a-46e6-88a1-5ebaeed2ad0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:26.760527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c7354-174a-46e6-88a1-5ebaeed2ad0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:26.770852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c7354-174a-46e6-88a1-5ebaeed2ad0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:26.772313 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c7354-174a-46e6-88a1-5ebaeed2ad0c service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:26.781707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1112/2233] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:27.172743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a943ee-c136-468d-be42-f8bb6996b1b6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:27.174243 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-77a943ee-c136-468d-be42-f8bb6996b1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:27.187554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a943ee-c136-468d-be42-f8bb6996b1b6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:27.200836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:27.202325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.203641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.204468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] PATH_INFO: `/v3/projects/62c3bc9dcafa436c8ea4dd5b5d6a69af` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.206756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c3bc9dcafa436c8ea4dd5b5d6a69af)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:27.208825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:27.267399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c3bc9dcafa436c8ea4dd5b5d6a69af', 'request_id': 'req-3979e452-7a3a-49ac-865c-15d268fa99ef'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:27.276642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c3bc9dcafa436c8ea4dd5b5d6a69af', 'request_id': 'req-3979e452-7a3a-49ac-865c-15d268fa99ef'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:27.284102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c3bc9dcafa436c8ea4dd5b5d6a69af', 'request_id': 'req-3979e452-7a3a-49ac-865c-15d268fa99ef'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:27.298184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] The token cache is being invalidate because project 62c3bc9dcafa436c8ea4dd5b5d6a69af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:27.298544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:27.299641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-3979e452-7a3a-49ac-865c-15d268fa99ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:27.302068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1122/2234] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:27 2022] DELETE /identity/v3/projects/62c3bc9dcafa436c8ea4dd5b5d6a69af => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:27.307149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd10c0-ff8c-42ac-bf0f-e9137fe9e1e8 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.307615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd10c0-ff8c-42ac-bf0f-e9137fe9e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.307702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd10c0-ff8c-42ac-bf0f-e9137fe9e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.329129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ebdd10c0-ff8c-42ac-bf0f-e9137fe9e1e8 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:27.330742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ebdd10c0-ff8c-42ac-bf0f-e9137fe9e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:27.408560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1113/2235] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:27.416635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd673a-f4e7-4e8f-9150-508cfd6e7684 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.416931 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd673a-f4e7-4e8f-9150-508cfd6e7684 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.417224 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd673a-f4e7-4e8f-9150-508cfd6e7684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.457788 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-cfdd673a-f4e7-4e8f-9150-508cfd6e7684 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:27.459038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-cfdd673a-f4e7-4e8f-9150-508cfd6e7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:27.478855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1123/2236] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:27.491846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd10c0-ff8c-42ac-bf0f-e9137fe9e1e8 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:27.516488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd10c0-ff8c-42ac-bf0f-e9137fe9e1e8 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:27.533573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b110cfc-4d69-4fcf-8f67-a67d0fb5d5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:27.534261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110cfc-4d69-4fcf-8f67-a67d0fb5d5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.534579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110cfc-4d69-4fcf-8f67-a67d0fb5d5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.534858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110cfc-4d69-4fcf-8f67-a67d0fb5d5a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.535603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b110cfc-4d69-4fcf-8f67-a67d0fb5d5a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:27.535991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b110cfc-4d69-4fcf-8f67-a67d0fb5d5a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:27.537641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b110cfc-4d69-4fcf-8f67-a67d0fb5d5a2 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:27.558485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1114/2237] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:27.559700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd673a-f4e7-4e8f-9150-508cfd6e7684 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:27.590476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd673a-f4e7-4e8f-9150-508cfd6e7684 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:27.599427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228fa37-003e-42cf-b69f-5dad18819d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:27.600561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228fa37-003e-42cf-b69f-5dad18819d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.600946 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228fa37-003e-42cf-b69f-5dad18819d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.601344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228fa37-003e-42cf-b69f-5dad18819d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.602711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228fa37-003e-42cf-b69f-5dad18819d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:27.605150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228fa37-003e-42cf-b69f-5dad18819d52 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:27.682335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1124/2238] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:27 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:27.686373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b110cfc-4d69-4fcf-8f67-a67d0fb5d5a2 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:27.697004 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b110cfc-4d69-4fcf-8f67-a67d0fb5d5a2 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:27.767738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749ac49-681c-44fa-9fdc-ce38178dca8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:27.768800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749ac49-681c-44fa-9fdc-ce38178dca8f admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.768800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749ac49-681c-44fa-9fdc-ce38178dca8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.769006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749ac49-681c-44fa-9fdc-ce38178dca8f admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.769662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749ac49-681c-44fa-9fdc-ce38178dca8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:27.771686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749ac49-681c-44fa-9fdc-ce38178dca8f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:27.796597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1115/2239] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:27 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:27.800669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228fa37-003e-42cf-b69f-5dad18819d52 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:27.812192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228fa37-003e-42cf-b69f-5dad18819d52 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:27.817296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae1389-e2d0-4417-9c95-d2c939b5312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:27.818088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1389-e2d0-4417-9c95-d2c939b5312e admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.818855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1389-e2d0-4417-9c95-d2c939b5312e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.818855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae1389-e2d0-4417-9c95-d2c939b5312e admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.819650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae1389-e2d0-4417-9c95-d2c939b5312e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:27.821961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae1389-e2d0-4417-9c95-d2c939b5312e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:27.840176 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1125/2240] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:27.840282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749ac49-681c-44fa-9fdc-ce38178dca8f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:27.848558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749ac49-681c-44fa-9fdc-ce38178dca8f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:27.854347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16741f0c-1007-4d68-be00-3e6a9b40a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:27.855592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16741f0c-1007-4d68-be00-3e6a9b40a105 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.855893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16741f0c-1007-4d68-be00-3e6a9b40a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.856303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16741f0c-1007-4d68-be00-3e6a9b40a105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.857039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16741f0c-1007-4d68-be00-3e6a9b40a105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:27.859093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16741f0c-1007-4d68-be00-3e6a9b40a105 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:27.870422 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1116/2241] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:27.874291 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae1389-e2d0-4417-9c95-d2c939b5312e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:27.891394 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae1389-e2d0-4417-9c95-d2c939b5312e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:27.902040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbdb06-ccaa-4413-a54a-dcb0a1544892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:27.903284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbdb06-ccaa-4413-a54a-dcb0a1544892 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.903846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbdb06-ccaa-4413-a54a-dcb0a1544892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.904397 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbdb06-ccaa-4413-a54a-dcb0a1544892 admin admin] PATH_INFO: `/v3/projects/5bbfadc2180f4a10bf6fab495d3106d7/users/3dd7fe155f924c92818239d59769364c/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.921117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbdb06-ccaa-4413-a54a-dcb0a1544892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bbfadc2180f4a10bf6fab495d3106d7, user_id=3dd7fe155f924c92818239d59769364c, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:27.924048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbdb06-ccaa-4413-a54a-dcb0a1544892 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:27.955693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1126/2242] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:27 2022] PUT /identity/v3/projects/5bbfadc2180f4a10bf6fab495d3106d7/users/3dd7fe155f924c92818239d59769364c/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:27.967698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e9a04-ad76-4f52-a0d7-edcff3952da5 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.968042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e9a04-ad76-4f52-a0d7-edcff3952da5 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.968335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e9a04-ad76-4f52-a0d7-edcff3952da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:28.000166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-917e9a04-ad76-4f52-a0d7-edcff3952da5 None None] MFA Rules not processed for user `3dd7fe155f924c92818239d59769364c`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:28.001441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-917e9a04-ad76-4f52-a0d7-edcff3952da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:28.006134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:28.101219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1117/2243] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:28.113969 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbdb06-ccaa-4413-a54a-dcb0a1544892 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:28.115695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-48cbdb06-ccaa-4413-a54a-dcb0a1544892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:28.179544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbdb06-ccaa-4413-a54a-dcb0a1544892 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:28.185864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f16e9e-3458-4418-96a9-daca32ee02ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:28.186825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f16e9e-3458-4418-96a9-daca32ee02ea service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:28.187262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f16e9e-3458-4418-96a9-daca32ee02ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:28.187722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f16e9e-3458-4418-96a9-daca32ee02ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:28.194819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:28.199829 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f16e9e-3458-4418-96a9-daca32ee02ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:28.201683 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f16e9e-3458-4418-96a9-daca32ee02ea service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:28.213940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1127/2244] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:32.452807 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e9a04-ad76-4f52-a0d7-edcff3952da5 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:32.454487 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-917e9a04-ad76-4f52-a0d7-edcff3952da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:32.532626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e9a04-ad76-4f52-a0d7-edcff3952da5 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:32.537090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:32.537962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:32.538238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:32.538508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] PATH_INFO: `/v3/users/345e9779a6a340bba9ae476957b5e2de` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:32.539798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] RBAC: Authorizing `identity:delete_user(user_id=345e9779a6a340bba9ae476957b5e2de)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:32.541673 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:32.589995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345e9779a6a340bba9ae476957b5e2de'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:32.601543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345e9779a6a340bba9ae476957b5e2de'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:32.602199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345e9779a6a340bba9ae476957b5e2de'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:32.609242 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345e9779a6a340bba9ae476957b5e2de'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:32.616105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345e9779a6a340bba9ae476957b5e2de'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:32.622541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1118/2245] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:32 2022] DELETE /identity/v3/users/345e9779a6a340bba9ae476957b5e2de => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:32.626991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7793f1-34a4-4faf-bec5-04c1b51e6555 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:32.627483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7793f1-34a4-4faf-bec5-04c1b51e6555 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:32.627594 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7793f1-34a4-4faf-bec5-04c1b51e6555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:32.644571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-dc7793f1-34a4-4faf-bec5-04c1b51e6555 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:32.645799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-dc7793f1-34a4-4faf-bec5-04c1b51e6555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:32.706179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1128/2246] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:32.715843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:32.717770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:32.756154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:32.787901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6f6eb-2ed8-4951-a06a-c8edcb13209e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:32.791419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61002133-c03b-40f5-94bc-3488bb90135d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:32.792096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61002133-c03b-40f5-94bc-3488bb90135d service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:32.792379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61002133-c03b-40f5-94bc-3488bb90135d service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:32.792656 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61002133-c03b-40f5-94bc-3488bb90135d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:32.801928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61002133-c03b-40f5-94bc-3488bb90135d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:32.803364 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61002133-c03b-40f5-94bc-3488bb90135d service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:32.813311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1119/2247] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:33.224979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7793f1-34a4-4faf-bec5-04c1b51e6555 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:33.226449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-dc7793f1-34a4-4faf-bec5-04c1b51e6555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:33.243562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7793f1-34a4-4faf-bec5-04c1b51e6555 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:33.249920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:33.250823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.251107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.251387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] PATH_INFO: `/v3/projects/01eeccb088fb43dc9099d3109d9e20a4` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.253222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01eeccb088fb43dc9099d3109d9e20a4)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:33.256314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:33.309603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01eeccb088fb43dc9099d3109d9e20a4', 'request_id': 'req-bb204132-c1b0-4488-b696-6675a33224d9'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:33.317467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01eeccb088fb43dc9099d3109d9e20a4', 'request_id': 'req-bb204132-c1b0-4488-b696-6675a33224d9'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:33.325909 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01eeccb088fb43dc9099d3109d9e20a4', 'request_id': 'req-bb204132-c1b0-4488-b696-6675a33224d9'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:33.339467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] The token cache is being invalidate because project 01eeccb088fb43dc9099d3109d9e20a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:33.340045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:33.340709 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-bb204132-c1b0-4488-b696-6675a33224d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:33.342415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1129/2248] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:33 2022] DELETE /identity/v3/projects/01eeccb088fb43dc9099d3109d9e20a4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:33.347645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f08d-7805-4612-aaa8-fafd69b2240e None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.347993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f08d-7805-4612-aaa8-fafd69b2240e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.348232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f08d-7805-4612-aaa8-fafd69b2240e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.367388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-04c5f08d-7805-4612-aaa8-fafd69b2240e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:33.368891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-04c5f08d-7805-4612-aaa8-fafd69b2240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:33.465790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1120/2249] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:33.474253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cf5e7-a4e3-447b-b203-fc50b882d83d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.474547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cf5e7-a4e3-447b-b203-fc50b882d83d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.474839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04cf5e7-a4e3-447b-b203-fc50b882d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.524083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c04cf5e7-a4e3-447b-b203-fc50b882d83d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:33.525351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c04cf5e7-a4e3-447b-b203-fc50b882d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:33.547414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1130/2250] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:33.551885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5f08d-7805-4612-aaa8-fafd69b2240e None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:33.570576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5f08d-7805-4612-aaa8-fafd69b2240e None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:33.577233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e58bf-9206-4ec2-b491-3482819e74d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:33.578457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e58bf-9206-4ec2-b491-3482819e74d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.578820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e58bf-9206-4ec2-b491-3482819e74d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.579102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e58bf-9206-4ec2-b491-3482819e74d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.580508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e58bf-9206-4ec2-b491-3482819e74d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:33.580827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e58bf-9206-4ec2-b491-3482819e74d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:33.582778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e58bf-9206-4ec2-b491-3482819e74d1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:33.604202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1121/2251] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:33.604994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cf5e7-a4e3-447b-b203-fc50b882d83d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:33.616408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04cf5e7-a4e3-447b-b203-fc50b882d83d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:33.622138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4fc40-3cf2-47e2-a326-25eb47770c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:33.622869 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4fc40-3cf2-47e2-a326-25eb47770c62 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.623153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4fc40-3cf2-47e2-a326-25eb47770c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.623484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4fc40-3cf2-47e2-a326-25eb47770c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.624784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4fc40-3cf2-47e2-a326-25eb47770c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:33.635402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4fc40-3cf2-47e2-a326-25eb47770c62 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:33.665628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1131/2252] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:33 2022] POST /identity/v3/projects => generated 399 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:33.670317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e58bf-9206-4ec2-b491-3482819e74d1 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:33.681270 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e58bf-9206-4ec2-b491-3482819e74d1 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:33.746564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccff08-65f9-4776-8d67-1d72a18a5a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:33.747249 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccff08-65f9-4776-8d67-1d72a18a5a5f admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.747675 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccff08-65f9-4776-8d67-1d72a18a5a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.747956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccff08-65f9-4776-8d67-1d72a18a5a5f admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.748688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccff08-65f9-4776-8d67-1d72a18a5a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:33.750810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccff08-65f9-4776-8d67-1d72a18a5a5f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:33.773072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1122/2253] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:33 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:33.777736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4fc40-3cf2-47e2-a326-25eb47770c62 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:33.788847 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4fc40-3cf2-47e2-a326-25eb47770c62 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:33.793815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11700-2c48-4a5f-915f-29fd4ed6b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:33.795453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11700-2c48-4a5f-915f-29fd4ed6b118 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.795805 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11700-2c48-4a5f-915f-29fd4ed6b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.796184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11700-2c48-4a5f-915f-29fd4ed6b118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.796980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d11700-2c48-4a5f-915f-29fd4ed6b118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:33.799037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d11700-2c48-4a5f-915f-29fd4ed6b118 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:33.809968 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1132/2254] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:33.814386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccff08-65f9-4776-8d67-1d72a18a5a5f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:33.825471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccff08-65f9-4776-8d67-1d72a18a5a5f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:33.830717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428117b-71ed-4f92-b246-104e7b3899b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:33.831427 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428117b-71ed-4f92-b246-104e7b3899b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.831717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428117b-71ed-4f92-b246-104e7b3899b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.832023 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428117b-71ed-4f92-b246-104e7b3899b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.832748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428117b-71ed-4f92-b246-104e7b3899b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:33.834356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428117b-71ed-4f92-b246-104e7b3899b2 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:33.844942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1123/2255] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:33.849026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11700-2c48-4a5f-915f-29fd4ed6b118 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:33.858773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11700-2c48-4a5f-915f-29fd4ed6b118 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:33.863477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81230f-8df0-4ef8-b8e4-02d12f9fab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:33.864385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81230f-8df0-4ef8-b8e4-02d12f9fab87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.864672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81230f-8df0-4ef8-b8e4-02d12f9fab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.864947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81230f-8df0-4ef8-b8e4-02d12f9fab87 admin admin] PATH_INFO: `/v3/projects/fec4d397bbb349978ffc19c5e6fe93fa/users/cf1d1e7433f64011bac970b211a48577/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.882604 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81230f-8df0-4ef8-b8e4-02d12f9fab87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec4d397bbb349978ffc19c5e6fe93fa, user_id=cf1d1e7433f64011bac970b211a48577, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:33.885830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81230f-8df0-4ef8-b8e4-02d12f9fab87 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:33.899564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1133/2256] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:33 2022] PUT /identity/v3/projects/fec4d397bbb349978ffc19c5e6fe93fa/users/cf1d1e7433f64011bac970b211a48577/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:33.910322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c087685-2044-4275-b928-122d209c0962 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.910621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c087685-2044-4275-b928-122d209c0962 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.910909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c087685-2044-4275-b928-122d209c0962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.936622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2c087685-2044-4275-b928-122d209c0962 None None] MFA Rules not processed for user `cf1d1e7433f64011bac970b211a48577`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:33.937820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2c087685-2044-4275-b928-122d209c0962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:33.957813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:34.002517 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1124/2257] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:34.015638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81230f-8df0-4ef8-b8e4-02d12f9fab87 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:34.017357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3e81230f-8df0-4ef8-b8e4-02d12f9fab87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:34.034851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:34.078377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81230f-8df0-4ef8-b8e4-02d12f9fab87 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:34.082587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a26e41-7b73-4fe1-999f-77341216f298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:34.083235 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26e41-7b73-4fe1-999f-77341216f298 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:34.083515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26e41-7b73-4fe1-999f-77341216f298 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:34.083788 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a26e41-7b73-4fe1-999f-77341216f298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:34.093500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a26e41-7b73-4fe1-999f-77341216f298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:34.095059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a26e41-7b73-4fe1-999f-77341216f298 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:34.103742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1134/2258] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:39.064992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c087685-2044-4275-b928-122d209c0962 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.130545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c087685-2044-4275-b928-122d209c0962 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.135538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.136452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.136737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.137008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] PATH_INFO: `/v3/users/cf1d1e7433f64011bac970b211a48577` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.138189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1d1e7433f64011bac970b211a48577)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.140154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.186784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1d1e7433f64011bac970b211a48577'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:39.199067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1d1e7433f64011bac970b211a48577'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:39.199725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1d1e7433f64011bac970b211a48577'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:39.206772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1d1e7433f64011bac970b211a48577'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:39.214646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1d1e7433f64011bac970b211a48577'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:39.220661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1125/2259] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:39 2022] DELETE /identity/v3/users/cf1d1e7433f64011bac970b211a48577 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:39.225290 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57c4a-9e12-4472-b72e-584033c5b190 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.225740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57c4a-9e12-4472-b72e-584033c5b190 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.225862 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb57c4a-9e12-4472-b72e-584033c5b190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.243306 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6bb57c4a-9e12-4472-b72e-584033c5b190 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:39.244553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6bb57c4a-9e12-4472-b72e-584033c5b190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:39.307854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1135/2260] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:39.317585 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.319128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:39.370724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:39.386752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f501e10-0e32-4ca2-90ae-184fb9319d6e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.390628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544acd80-f524-4ea7-a9e5-8eb56de33c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.391342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544acd80-f524-4ea7-a9e5-8eb56de33c0a service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.391626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544acd80-f524-4ea7-a9e5-8eb56de33c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.391905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544acd80-f524-4ea7-a9e5-8eb56de33c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.400966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544acd80-f524-4ea7-a9e5-8eb56de33c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.402397 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544acd80-f524-4ea7-a9e5-8eb56de33c0a service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.411889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1126/2261] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:39.675502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb57c4a-9e12-4472-b72e-584033c5b190 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.677098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6bb57c4a-9e12-4472-b72e-584033c5b190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:39.697993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb57c4a-9e12-4472-b72e-584033c5b190 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.710268 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.711342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.711892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.712316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] PATH_INFO: `/v3/projects/fec4d397bbb349978ffc19c5e6fe93fa` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.713679 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec4d397bbb349978ffc19c5e6fe93fa)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.715749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.774077 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec4d397bbb349978ffc19c5e6fe93fa', 'request_id': 'req-9b950a32-b159-439c-8411-ed79cc7d8103'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:39.781627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec4d397bbb349978ffc19c5e6fe93fa', 'request_id': 'req-9b950a32-b159-439c-8411-ed79cc7d8103'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:39.787262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec4d397bbb349978ffc19c5e6fe93fa', 'request_id': 'req-9b950a32-b159-439c-8411-ed79cc7d8103'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:39.799485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] The token cache is being invalidate because project fec4d397bbb349978ffc19c5e6fe93fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:39.799777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:39.800451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:39.802121 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1136/2262] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:39 2022] DELETE /identity/v3/projects/fec4d397bbb349978ffc19c5e6fe93fa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:41.731163 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9af7-bf73-4889-a1d2-3139a2ca8a4c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:41.731811 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9af7-bf73-4889-a1d2-3139a2ca8a4c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:41.732228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9af7-bf73-4889-a1d2-3139a2ca8a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:41.751454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-8ddf9af7-bf73-4889-a1d2-3139a2ca8a4c None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:41.752596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8ddf9af7-bf73-4889-a1d2-3139a2ca8a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:41.809360 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1127/2263] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:26:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:41.849988 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:41.851508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:41.899215 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:41.928424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b950a32-b159-439c-8411-ed79cc7d8103 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:41.933426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9ed12-a595-4aa0-a238-60279231c6c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:41.934072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9ed12-a595-4aa0-a238-60279231c6c2 service swift] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:41.934360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9ed12-a595-4aa0-a238-60279231c6c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:41.934638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9ed12-a595-4aa0-a238-60279231c6c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:41.942577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9ed12-a595-4aa0-a238-60279231c6c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:41.944215 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9ed12-a595-4aa0-a238-60279231c6c2 service swift] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:41.963602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1137/2264] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:26:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:26:51.800174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=32 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:51.959080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=14 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:04.141909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cc461-e035-49a2-9811-7798886cf589 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:04.142437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cc461-e035-49a2-9811-7798886cf589 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:04.142535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cc461-e035-49a2-9811-7798886cf589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:04.169716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-839cc461-e035-49a2-9811-7798886cf589 None None] MFA Rules not processed for user `71cddd4efaaf4298934a4f601d746175`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:04.170917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-839cc461-e035-49a2-9811-7798886cf589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:04.242736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1128/2265] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:05.243500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd36e6-8b95-4f06-8edf-21de01577cf6 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.244063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd36e6-8b95-4f06-8edf-21de01577cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.244341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd36e6-8b95-4f06-8edf-21de01577cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:05.268680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6cfd36e6-8b95-4f06-8edf-21de01577cf6 None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:05.270037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6cfd36e6-8b95-4f06-8edf-21de01577cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:05.300525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1138/2266] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 16 00:27:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:05.316284 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cc461-e035-49a2-9811-7798886cf589 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:05.340894 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cc461-e035-49a2-9811-7798886cf589 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:05.347584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3f942-8948-4623-8f91-f3a3cf7e32d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:05.348531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3f942-8948-4623-8f91-f3a3cf7e32d1 service swift] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.348817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3f942-8948-4623-8f91-f3a3cf7e32d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.349247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3f942-8948-4623-8f91-f3a3cf7e32d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:05.359621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3f942-8948-4623-8f91-f3a3cf7e32d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:05.361907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3f942-8948-4623-8f91-f3a3cf7e32d1 service swift] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:05.383350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1129/2267] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:27:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:06.091159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd36e6-8b95-4f06-8edf-21de01577cf6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.092909 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6cfd36e6-8b95-4f06-8edf-21de01577cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:06.230115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd36e6-8b95-4f06-8edf-21de01577cf6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.235087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.236119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.236308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.236593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] PATH_INFO: `/v3/users/3dd7fe155f924c92818239d59769364c` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.237817 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd7fe155f924c92818239d59769364c)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.239752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.295364 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd7fe155f924c92818239d59769364c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:06.296185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd7fe155f924c92818239d59769364c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:06.309557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd7fe155f924c92818239d59769364c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:06.310260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd7fe155f924c92818239d59769364c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:06.319054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd7fe155f924c92818239d59769364c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:06.332910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1139/2268] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:06 2022] DELETE /identity/v3/users/3dd7fe155f924c92818239d59769364c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:06.338047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89dc80-4c8a-4e9a-b1e9-3dbd3a80c988 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.338545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89dc80-4c8a-4e9a-b1e9-3dbd3a80c988 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.338646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89dc80-4c8a-4e9a-b1e9-3dbd3a80c988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.377882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4b89dc80-4c8a-4e9a-b1e9-3dbd3a80c988 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:06.379098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4b89dc80-4c8a-4e9a-b1e9-3dbd3a80c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:06.447842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1130/2269] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:06.458801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.460895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:06.514878 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:06.579342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd69b10-c0d9-49c6-a820-e939a77948a6 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.583850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e861601-a2d4-4091-ad15-055136efed89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.584848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861601-a2d4-4091-ad15-055136efed89 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.584848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861601-a2d4-4091-ad15-055136efed89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.584848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861601-a2d4-4091-ad15-055136efed89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.596313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e861601-a2d4-4091-ad15-055136efed89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.597873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e861601-a2d4-4091-ad15-055136efed89 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.609034 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1140/2270] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:06.958870 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89dc80-4c8a-4e9a-b1e9-3dbd3a80c988 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.962635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4b89dc80-4c8a-4e9a-b1e9-3dbd3a80c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:06.979035 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89dc80-4c8a-4e9a-b1e9-3dbd3a80c988 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.984353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.985326 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.985660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.985953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] PATH_INFO: `/v3/projects/5bbfadc2180f4a10bf6fab495d3106d7` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.987933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bbfadc2180f4a10bf6fab495d3106d7)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.990106 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:07.046268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:07.048185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bbfadc2180f4a10bf6fab495d3106d7', 'request_id': 'req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:07.058857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bbfadc2180f4a10bf6fab495d3106d7', 'request_id': 'req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:07.066489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bbfadc2180f4a10bf6fab495d3106d7', 'request_id': 'req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:07.086154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] The token cache is being invalidate because project 5bbfadc2180f4a10bf6fab495d3106d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:07.086525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:07.087438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-97e6f94d-b894-4e2a-8b5c-8aaa2aba36a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:07.089254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1131/2271] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:06 2022] DELETE /identity/v3/projects/5bbfadc2180f4a10bf6fab495d3106d7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:07.094558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd758a0-3a7d-40a6-8f29-8d3122839044 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.094558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd758a0-3a7d-40a6-8f29-8d3122839044 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.094558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd758a0-3a7d-40a6-8f29-8d3122839044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.141134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ebd758a0-3a7d-40a6-8f29-8d3122839044 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:07.142112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ebd758a0-3a7d-40a6-8f29-8d3122839044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:07.214212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1141/2272] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:07.221716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba11cd2-46b8-4b87-a344-3c3a1f01f1ef None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.222005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba11cd2-46b8-4b87-a344-3c3a1f01f1ef None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.222281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba11cd2-46b8-4b87-a344-3c3a1f01f1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.263442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-9ba11cd2-46b8-4b87-a344-3c3a1f01f1ef None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:07.268993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9ba11cd2-46b8-4b87-a344-3c3a1f01f1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:07.288821 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1132/2273] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:07.297734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd758a0-3a7d-40a6-8f29-8d3122839044 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:07.311235 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd758a0-3a7d-40a6-8f29-8d3122839044 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:07.316581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12637b8-8790-4e6e-baa9-db6c01f2f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:07.317367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12637b8-8790-4e6e-baa9-db6c01f2f55f admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.317754 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12637b8-8790-4e6e-baa9-db6c01f2f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.318134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12637b8-8790-4e6e-baa9-db6c01f2f55f admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.319798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12637b8-8790-4e6e-baa9-db6c01f2f55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:07.320227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12637b8-8790-4e6e-baa9-db6c01f2f55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:07.321910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12637b8-8790-4e6e-baa9-db6c01f2f55f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:07.337297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1142/2274] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:27:07.341245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba11cd2-46b8-4b87-a344-3c3a1f01f1ef None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:07.357969 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba11cd2-46b8-4b87-a344-3c3a1f01f1ef None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:07.363227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385dce5-55e6-4c34-888d-a4277f603ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:07.363895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385dce5-55e6-4c34-888d-a4277f603ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.364223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385dce5-55e6-4c34-888d-a4277f603ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.364840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385dce5-55e6-4c34-888d-a4277f603ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.366574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385dce5-55e6-4c34-888d-a4277f603ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:07.368706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385dce5-55e6-4c34-888d-a4277f603ef2 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:07.399157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1133/2275] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:07 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:07.403302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12637b8-8790-4e6e-baa9-db6c01f2f55f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:07.414707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12637b8-8790-4e6e-baa9-db6c01f2f55f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:07.503880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efded8-3248-4943-95e4-a8efbe56c069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:07.505196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efded8-3248-4943-95e4-a8efbe56c069 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.506717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efded8-3248-4943-95e4-a8efbe56c069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.507023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efded8-3248-4943-95e4-a8efbe56c069 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.507791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efded8-3248-4943-95e4-a8efbe56c069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:07.509760 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efded8-3248-4943-95e4-a8efbe56c069 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:07.550039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1143/2276] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:07 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:07.554023 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385dce5-55e6-4c34-888d-a4277f603ef2 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:07.564610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385dce5-55e6-4c34-888d-a4277f603ef2 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:07.570031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac54c5-6fbd-4a65-ad07-e59b88f9a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:07.570856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac54c5-6fbd-4a65-ad07-e59b88f9a67c admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.570998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac54c5-6fbd-4a65-ad07-e59b88f9a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.571413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac54c5-6fbd-4a65-ad07-e59b88f9a67c admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.572199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac54c5-6fbd-4a65-ad07-e59b88f9a67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:07.574069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac54c5-6fbd-4a65-ad07-e59b88f9a67c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:07.586031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1134/2277] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:07.589959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efded8-3248-4943-95e4-a8efbe56c069 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:07.602132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efded8-3248-4943-95e4-a8efbe56c069 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:07.607746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9759fec-dffd-4af1-885b-407deedd7543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:07.608436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759fec-dffd-4af1-885b-407deedd7543 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.608732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759fec-dffd-4af1-885b-407deedd7543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.609070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759fec-dffd-4af1-885b-407deedd7543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.609754 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9759fec-dffd-4af1-885b-407deedd7543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:07.611601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9759fec-dffd-4af1-885b-407deedd7543 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:07.632847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac54c5-6fbd-4a65-ad07-e59b88f9a67c admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:07.640605 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1144/2278] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:07.645787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac54c5-6fbd-4a65-ad07-e59b88f9a67c admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:07.652096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07ed20-9c3c-4dc6-8ea5-5f85350e2c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:07.653150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07ed20-9c3c-4dc6-8ea5-5f85350e2c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.653543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07ed20-9c3c-4dc6-8ea5-5f85350e2c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.654623 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07ed20-9c3c-4dc6-8ea5-5f85350e2c42 admin admin] PATH_INFO: `/v3/projects/7a476d3927f44b85a0f0537fba68a9f2/users/876a3e2d8c0145a5ad00fc3f79f50fb3/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.686092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07ed20-9c3c-4dc6-8ea5-5f85350e2c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a476d3927f44b85a0f0537fba68a9f2, user_id=876a3e2d8c0145a5ad00fc3f79f50fb3, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:07.689494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07ed20-9c3c-4dc6-8ea5-5f85350e2c42 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:07.707192 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1135/2279] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:07 2022] PUT /identity/v3/projects/7a476d3927f44b85a0f0537fba68a9f2/users/876a3e2d8c0145a5ad00fc3f79f50fb3/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:07.719173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e264ed5-990f-4cfd-aab2-b4e4ebda44ed None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.719472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e264ed5-990f-4cfd-aab2-b4e4ebda44ed None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.719798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e264ed5-990f-4cfd-aab2-b4e4ebda44ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.727530 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:07.752727 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07ed20-9c3c-4dc6-8ea5-5f85350e2c42 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:07.754627 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-1e07ed20-9c3c-4dc6-8ea5-5f85350e2c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:07.792041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-1e264ed5-990f-4cfd-aab2-b4e4ebda44ed None None] MFA Rules not processed for user `876a3e2d8c0145a5ad00fc3f79f50fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:07.795191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1e264ed5-990f-4cfd-aab2-b4e4ebda44ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:07.889354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07ed20-9c3c-4dc6-8ea5-5f85350e2c42 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:07.903484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:07.904820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.905395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.905684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] PATH_INFO: `/v3/users/46d57f08982847ff9771802e3cbd4297` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.909927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d57f08982847ff9771802e3cbd4297)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:07.913886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:07.949801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1145/2280] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:07.962266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e264ed5-990f-4cfd-aab2-b4e4ebda44ed None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:07.963803 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1e264ed5-990f-4cfd-aab2-b4e4ebda44ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:08.001118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d57f08982847ff9771802e3cbd4297'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.032500 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d57f08982847ff9771802e3cbd4297'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.034381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d57f08982847ff9771802e3cbd4297'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.052776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d57f08982847ff9771802e3cbd4297'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.055749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:08.066758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d57f08982847ff9771802e3cbd4297'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.078144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1136/2281] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:07 2022] DELETE /identity/v3/users/46d57f08982847ff9771802e3cbd4297 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:08.097919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e264ed5-990f-4cfd-aab2-b4e4ebda44ed None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:08.173960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8794c8-1c13-405d-b8d3-86090371dcdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:08.174722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8794c8-1c13-405d-b8d3-86090371dcdb service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:08.175728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8794c8-1c13-405d-b8d3-86090371dcdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:08.176119 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8794c8-1c13-405d-b8d3-86090371dcdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:08.178000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9b8794c8-1c13-405d-b8d3-86090371dcdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:08.295010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8794c8-1c13-405d-b8d3-86090371dcdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:08.296588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8794c8-1c13-405d-b8d3-86090371dcdb service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:08.310643 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1146/2282] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:08.343191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:08.344640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:08.421074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96d911-67df-4aac-9acd-f5fb23c0f361 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:08.425896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:08.426786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:08.427370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:08.427510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] PATH_INFO: `/v3/users/876a3e2d8c0145a5ad00fc3f79f50fb3` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:08.429353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=876a3e2d8c0145a5ad00fc3f79f50fb3)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:08.431886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:08.497940 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876a3e2d8c0145a5ad00fc3f79f50fb3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.515572 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876a3e2d8c0145a5ad00fc3f79f50fb3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.516921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876a3e2d8c0145a5ad00fc3f79f50fb3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.526542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876a3e2d8c0145a5ad00fc3f79f50fb3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.536694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876a3e2d8c0145a5ad00fc3f79f50fb3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.559509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1137/2283] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:08 2022] DELETE /identity/v3/users/876a3e2d8c0145a5ad00fc3f79f50fb3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:08.565254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4b6f-4b2a-4876-b617-4922d98dd8f1 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:08.565548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4b6f-4b2a-4876-b617-4922d98dd8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:08.565850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4b6f-4b2a-4876-b617-4922d98dd8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:08.573366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:08.587707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-7ebc4b6f-4b2a-4876-b617-4922d98dd8f1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:08.589339 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7ebc4b6f-4b2a-4876-b617-4922d98dd8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:08.653346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:08.655147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:08.702895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1147/2284] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:08.739503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc4b6f-4b2a-4876-b617-4922d98dd8f1 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:08.742196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7ebc4b6f-4b2a-4876-b617-4922d98dd8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:08.754803 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c1c3f-c6a3-4791-8f22-e30c99c74d9e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:08.760737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:08.761561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:08.762366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:08.762366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] PATH_INFO: `/v3/projects/c520573dfe06412bb18459718b9e4b17` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:08.763639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c520573dfe06412bb18459718b9e4b17)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:08.766118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:08.781815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:08.826497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc4b6f-4b2a-4876-b617-4922d98dd8f1 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:08.833022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c520573dfe06412bb18459718b9e4b17', 'request_id': 'req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.846112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c520573dfe06412bb18459718b9e4b17', 'request_id': 'req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.854782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c520573dfe06412bb18459718b9e4b17', 'request_id': 'req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.868333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] The token cache is being invalidate because project c520573dfe06412bb18459718b9e4b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:08.868988 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.869311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-70324ecc-e92c-4d7e-9e43-c51caf0fed6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:08.871071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1138/2285] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:08 2022] DELETE /identity/v3/projects/c520573dfe06412bb18459718b9e4b17 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:08.876586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702a8f2-9311-4807-8d2c-2c3676b01828 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:08.876861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702a8f2-9311-4807-8d2c-2c3676b01828 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:08.877144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702a8f2-9311-4807-8d2c-2c3676b01828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:08.894326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58b70f-d4b3-483f-8216-2e0fabd54a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:08.895111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58b70f-d4b3-483f-8216-2e0fabd54a98 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:08.895401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58b70f-d4b3-483f-8216-2e0fabd54a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:08.895678 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58b70f-d4b3-483f-8216-2e0fabd54a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:08.898045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3f58b70f-d4b3-483f-8216-2e0fabd54a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:08.899666 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0702a8f2-9311-4807-8d2c-2c3676b01828 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:08.901102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0702a8f2-9311-4807-8d2c-2c3676b01828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:08.969935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58b70f-d4b3-483f-8216-2e0fabd54a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:08.971492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58b70f-d4b3-483f-8216-2e0fabd54a98 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:08.973441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1139/2286] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:08.981463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafff1-24d6-4e67-b744-de9b737ffd55 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:08.981758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafff1-24d6-4e67-b744-de9b737ffd55 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:08.982149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafff1-24d6-4e67-b744-de9b737ffd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:08.983755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1148/2287] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:09.002626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4faafff1-24d6-4e67-b744-de9b737ffd55 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:09.003932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4faafff1-24d6-4e67-b744-de9b737ffd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:09.016198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1140/2288] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:09.025844 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58b70f-d4b3-483f-8216-2e0fabd54a98 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:09.035944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58b70f-d4b3-483f-8216-2e0fabd54a98 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:09.042635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d26ba-913d-4450-abcf-7aca849a5d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:09.043365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d26ba-913d-4450-abcf-7aca849a5d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:09.043669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d26ba-913d-4450-abcf-7aca849a5d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:09.044011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d26ba-913d-4450-abcf-7aca849a5d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:09.044728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d26ba-913d-4450-abcf-7aca849a5d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:09.045040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d26ba-913d-4450-abcf-7aca849a5d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:09.046645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d26ba-913d-4450-abcf-7aca849a5d86 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:09.050374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:09.063886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1149/2289] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:09.070198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faafff1-24d6-4e67-b744-de9b737ffd55 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:09.086507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faafff1-24d6-4e67-b744-de9b737ffd55 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:09.096248 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8a865-b7a3-4cbd-baad-4ac3ca117f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:09.097069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8a865-b7a3-4cbd-baad-4ac3ca117f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:09.097529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8a865-b7a3-4cbd-baad-4ac3ca117f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:09.098342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8a865-b7a3-4cbd-baad-4ac3ca117f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:09.099223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8a865-b7a3-4cbd-baad-4ac3ca117f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:09.102448 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c8a865-b7a3-4cbd-baad-4ac3ca117f17 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:09.139509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1141/2290] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:09 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:09.143354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d26ba-913d-4450-abcf-7aca849a5d86 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:09.162208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d26ba-913d-4450-abcf-7aca849a5d86 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:09.310357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411ac97-08d0-476e-9223-c76065c80a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:09.311316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411ac97-08d0-476e-9223-c76065c80a56 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:09.312039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411ac97-08d0-476e-9223-c76065c80a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:09.312039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411ac97-08d0-476e-9223-c76065c80a56 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:09.312773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411ac97-08d0-476e-9223-c76065c80a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:09.314710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9411ac97-08d0-476e-9223-c76065c80a56 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:09.338686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8a865-b7a3-4cbd-baad-4ac3ca117f17 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:09.340906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-51c8a865-b7a3-4cbd-baad-4ac3ca117f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:09.344767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1150/2291] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:09 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:09.347233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bb48c-9631-46a1-88cf-68549ba15d5e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:09.347581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bb48c-9631-46a1-88cf-68549ba15d5e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:09.347880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bb48c-9631-46a1-88cf-68549ba15d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:09.355786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8a865-b7a3-4cbd-baad-4ac3ca117f17 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:09.361788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:09.362758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:09.363135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:09.363485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] PATH_INFO: `/v3/projects/7a476d3927f44b85a0f0537fba68a9f2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:09.364971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a476d3927f44b85a0f0537fba68a9f2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:09.367547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:09.374845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f94bb48c-9631-46a1-88cf-68549ba15d5e None None] MFA Rules not processed for user `8628dfd28dd641f88a53e9ff0da20d90`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:09.376323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f94bb48c-9631-46a1-88cf-68549ba15d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:09.421093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a476d3927f44b85a0f0537fba68a9f2', 'request_id': 'req-f3f93eee-8f92-4e43-997d-41d77c4116bc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:09.437719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a476d3927f44b85a0f0537fba68a9f2', 'request_id': 'req-f3f93eee-8f92-4e43-997d-41d77c4116bc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:09.446067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a476d3927f44b85a0f0537fba68a9f2', 'request_id': 'req-f3f93eee-8f92-4e43-997d-41d77c4116bc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:09.449639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:09.453363 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1151/2292] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:09.455339 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bb48c-9631-46a1-88cf-68549ba15d5e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:09.464595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] The token cache is being invalidate because project 7a476d3927f44b85a0f0537fba68a9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:09.465217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:09.466091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:09.467754 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bb48c-9631-46a1-88cf-68549ba15d5e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:09.469034 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1142/2293] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:09 2022] DELETE /identity/v3/projects/7a476d3927f44b85a0f0537fba68a9f2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:09.561036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5939d-9e77-4969-ba70-67a2e6a33865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:09.562288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5939d-9e77-4969-ba70-67a2e6a33865 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:09.562763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5939d-9e77-4969-ba70-67a2e6a33865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:09.563223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5939d-9e77-4969-ba70-67a2e6a33865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:09.564276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5939d-9e77-4969-ba70-67a2e6a33865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:09.566141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5939d-9e77-4969-ba70-67a2e6a33865 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:09.596224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:09.597790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:09.600557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1152/2294] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:09.611947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f93eee-8f92-4e43-997d-41d77c4116bc admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:09.617281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c123433-ae1a-4c53-b467-58dc39372232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:09.617984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c123433-ae1a-4c53-b467-58dc39372232 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:09.618291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c123433-ae1a-4c53-b467-58dc39372232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:09.618558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c123433-ae1a-4c53-b467-58dc39372232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:09.619304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c123433-ae1a-4c53-b467-58dc39372232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:09.621038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c123433-ae1a-4c53-b467-58dc39372232 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:09.632744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1143/2295] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:09.637126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5939d-9e77-4969-ba70-67a2e6a33865 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:09.652738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5939d-9e77-4969-ba70-67a2e6a33865 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:09.658346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e9845-63b4-4fc1-8a9f-c84922bb4945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:09.659277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e9845-63b4-4fc1-8a9f-c84922bb4945 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:09.659561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e9845-63b4-4fc1-8a9f-c84922bb4945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:09.659840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e9845-63b4-4fc1-8a9f-c84922bb4945 admin admin] PATH_INFO: `/v3/projects/63bf871d74724e03acc3d73573783aae/users/d1fe383726c647299ac3b72159c97bdd/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:09.679713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e9845-63b4-4fc1-8a9f-c84922bb4945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63bf871d74724e03acc3d73573783aae, user_id=d1fe383726c647299ac3b72159c97bdd, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:09.682523 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e9845-63b4-4fc1-8a9f-c84922bb4945 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:09.696318 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1153/2296] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:09 2022] PUT /identity/v3/projects/63bf871d74724e03acc3d73573783aae/users/d1fe383726c647299ac3b72159c97bdd/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:09.707255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a896b-0947-423d-b874-809841dab2b1 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:09.707547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a896b-0947-423d-b874-809841dab2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:09.707819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a896b-0947-423d-b874-809841dab2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:09.740489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-b63a896b-0947-423d-b874-809841dab2b1 None None] MFA Rules not processed for user `d1fe383726c647299ac3b72159c97bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:09.741920 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b63a896b-0947-423d-b874-809841dab2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:09.824906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1144/2297] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:09.833352 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e9845-63b4-4fc1-8a9f-c84922bb4945 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:09.836518 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-905e9845-63b4-4fc1-8a9f-c84922bb4945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:09.842331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:09.911648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e9845-63b4-4fc1-8a9f-c84922bb4945 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:09.916070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7389b-3a66-4900-9dd6-cdea1e708694 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee61aece9c64e74806248e4ac49cd47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:09.916898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7389b-3a66-4900-9dd6-cdea1e708694 service glance] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:09.917250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7389b-3a66-4900-9dd6-cdea1e708694 service glance] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:09.917597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7389b-3a66-4900-9dd6-cdea1e708694 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:09.927299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7389b-3a66-4900-9dd6-cdea1e708694 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:09.929519 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7389b-3a66-4900-9dd6-cdea1e708694 service glance] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:09.939868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1154/2298] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:18.239724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b5591-07cb-4662-b9a4-75c6d2f9899a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:18.240322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b5591-07cb-4662-b9a4-75c6d2f9899a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:18.240322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b5591-07cb-4662-b9a4-75c6d2f9899a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:18.269390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-ba2b5591-07cb-4662-b9a4-75c6d2f9899a None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:18.270586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ba2b5591-07cb-4662-b9a4-75c6d2f9899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:18.337640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1145/2299] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:27:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:18.355068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7389b-3a66-4900-9dd6-cdea1e708694 service glance] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:18.356654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3fe7389b-3a66-4900-9dd6-cdea1e708694 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:18.442909 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7389b-3a66-4900-9dd6-cdea1e708694 service glance] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:18.448515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88d2a5-129f-4d24-8344-801bd162b069 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:18.449169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d2a5-129f-4d24-8344-801bd162b069 service swift] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:18.449454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d2a5-129f-4d24-8344-801bd162b069 service swift] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:18.449731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d2a5-129f-4d24-8344-801bd162b069 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:18.458376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88d2a5-129f-4d24-8344-801bd162b069 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:18.460517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88d2a5-129f-4d24-8344-801bd162b069 service swift] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:18.468930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1155/2300] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:28.329045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=68 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:28.465490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=57 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:31.881797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4078c-0066-4de1-807a-6aa4aa401afb None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:31.882357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4078c-0066-4de1-807a-6aa4aa401afb None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:31.882469 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4078c-0066-4de1-807a-6aa4aa401afb None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:31.883762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1146/2301] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:27:31.892681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fa994-78d3-4787-ad03-cd1f772b63cf None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:31.893170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fa994-78d3-4787-ad03-cd1f772b63cf None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:31.893264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fa994-78d3-4787-ad03-cd1f772b63cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:31.957148 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-650fa994-78d3-4787-ad03-cd1f772b63cf None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:31.958382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-650fa994-78d3-4787-ad03-cd1f772b63cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:32.059380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1156/2302] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:27:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:32.075888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4078c-0066-4de1-807a-6aa4aa401afb None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:32.077704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-38e4078c-0066-4de1-807a-6aa4aa401afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:32.090831 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4078c-0066-4de1-807a-6aa4aa401afb None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:32.094479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4f3c5-07e0-4bdd-a94d-2a23c24e004a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee61aece9c64e74806248e4ac49cd47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:32.095124 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4f3c5-07e0-4bdd-a94d-2a23c24e004a service glance] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.095412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4f3c5-07e0-4bdd-a94d-2a23c24e004a service glance] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.095692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4f3c5-07e0-4bdd-a94d-2a23c24e004a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.106053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4f3c5-07e0-4bdd-a94d-2a23c24e004a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:32.107480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4f3c5-07e0-4bdd-a94d-2a23c24e004a service glance] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:32.118604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1147/2303] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:32.184866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3368ec2-b5a5-4393-87e6-a33816c7103a None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.185165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3368ec2-b5a5-4393-87e6-a33816c7103a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.185447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3368ec2-b5a5-4393-87e6-a33816c7103a None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.186862 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1157/2304] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:27:32.191467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9596b2-f316-431c-98be-860ad271a353 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.191764 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9596b2-f316-431c-98be-860ad271a353 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.192085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9596b2-f316-431c-98be-860ad271a353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.210640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-1c9596b2-f316-431c-98be-860ad271a353 None None] MFA Rules not processed for user `9c142f4d77b54982abcd4b76edbcb4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:32.211835 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-1c9596b2-f316-431c-98be-860ad271a353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:32.261974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1148/2305] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:27:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:32.273500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3368ec2-b5a5-4393-87e6-a33816c7103a None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:32.275171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d3368ec2-b5a5-4393-87e6-a33816c7103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:32.288504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3368ec2-b5a5-4393-87e6-a33816c7103a None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:32.291930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a2ce2-1509-4a74-b24b-560426b33f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:32.292585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a2ce2-1509-4a74-b24b-560426b33f15 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.292868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a2ce2-1509-4a74-b24b-560426b33f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.293142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a2ce2-1509-4a74-b24b-560426b33f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.300146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a2ce2-1509-4a74-b24b-560426b33f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:32.301563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a2ce2-1509-4a74-b24b-560426b33f15 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:32.309999 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1158/2306] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:32.390055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb564-2fd6-4c74-8282-2ef75c37ab19 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.390351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb564-2fd6-4c74-8282-2ef75c37ab19 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.390631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb564-2fd6-4c74-8282-2ef75c37ab19 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.392064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1149/2307] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:27:32.398055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf89435-7fa6-4029-8cf5-39d577dadf0d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.398384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf89435-7fa6-4029-8cf5-39d577dadf0d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.398690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf89435-7fa6-4029-8cf5-39d577dadf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.416827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-7cf89435-7fa6-4029-8cf5-39d577dadf0d None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:32.418040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7cf89435-7fa6-4029-8cf5-39d577dadf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:32.427227 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1159/2308] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:27:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:32.437453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eb564-2fd6-4c74-8282-2ef75c37ab19 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:32.448963 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eb564-2fd6-4c74-8282-2ef75c37ab19 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:32.452686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d85eb-d428-4f4b-9113-0bc522bbf220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:32.453324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d85eb-d428-4f4b-9113-0bc522bbf220 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.453611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d85eb-d428-4f4b-9113-0bc522bbf220 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.453893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d85eb-d428-4f4b-9113-0bc522bbf220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.464878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d85eb-d428-4f4b-9113-0bc522bbf220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:32.466300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d85eb-d428-4f4b-9113-0bc522bbf220 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:32.476882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1150/2309] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:34.895067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e268cc-d760-44fe-9528-f8fb8e9a07f8 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.895544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e268cc-d760-44fe-9528-f8fb8e9a07f8 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.895659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e268cc-d760-44fe-9528-f8fb8e9a07f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.913075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-50e268cc-d760-44fe-9528-f8fb8e9a07f8 None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:34.914269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-50e268cc-d760-44fe-9528-f8fb8e9a07f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:34.921298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1160/2310] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:27:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:34.933384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d85eb-d428-4f4b-9113-0bc522bbf220 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:34.945040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d85eb-d428-4f4b-9113-0bc522bbf220 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:34.950237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec23d1-8193-49e4-8b77-d9a29d2b69a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:34.950871 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec23d1-8193-49e4-8b77-d9a29d2b69a5 service swift] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.951159 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec23d1-8193-49e4-8b77-d9a29d2b69a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.951437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec23d1-8193-49e4-8b77-d9a29d2b69a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.959223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec23d1-8193-49e4-8b77-d9a29d2b69a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:34.960834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec23d1-8193-49e4-8b77-d9a29d2b69a5 service swift] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:34.968635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1151/2311] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:27:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:27:35.150498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e268cc-d760-44fe-9528-f8fb8e9a07f8 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.233181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e268cc-d760-44fe-9528-f8fb8e9a07f8 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.237907 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.238817 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.239225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.239671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] PATH_INFO: `/v3/users/d1fe383726c647299ac3b72159c97bdd` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.240978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1fe383726c647299ac3b72159c97bdd)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.243240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.267744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:35.297098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1fe383726c647299ac3b72159c97bdd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.297749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1fe383726c647299ac3b72159c97bdd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.310565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1fe383726c647299ac3b72159c97bdd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.311260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1fe383726c647299ac3b72159c97bdd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.318312 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1fe383726c647299ac3b72159c97bdd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.335820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1161/2312] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:35 2022] DELETE /identity/v3/users/d1fe383726c647299ac3b72159c97bdd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:35.341459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91de67-6801-4d25-afeb-c74cb6f663d2 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.341777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91de67-6801-4d25-afeb-c74cb6f663d2 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.342061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91de67-6801-4d25-afeb-c74cb6f663d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.367239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-de91de67-6801-4d25-afeb-c74cb6f663d2 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:35.370614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-de91de67-6801-4d25-afeb-c74cb6f663d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.458751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1152/2313] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:35.477681 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.480147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.588597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5e644-d3f0-4380-b415-0021e415d14c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.595577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b976d-3368-479b-a1e1-1bbb2e216888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.596509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b976d-3368-479b-a1e1-1bbb2e216888 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.596900 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b976d-3368-479b-a1e1-1bbb2e216888 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.597277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b976d-3368-479b-a1e1-1bbb2e216888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.629538 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b976d-3368-479b-a1e1-1bbb2e216888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.631806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b976d-3368-479b-a1e1-1bbb2e216888 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.643275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1162/2314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:35.943032 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91de67-6801-4d25-afeb-c74cb6f663d2 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.944578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-de91de67-6801-4d25-afeb-c74cb6f663d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.962661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91de67-6801-4d25-afeb-c74cb6f663d2 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.967984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.969402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.969810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.970065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] PATH_INFO: `/v3/projects/63bf871d74724e03acc3d73573783aae` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.971532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63bf871d74724e03acc3d73573783aae)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.974146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.049650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63bf871d74724e03acc3d73573783aae', 'request_id': 'req-ced0eaf6-b151-4c8b-ab58-39d053924790'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:36.059767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63bf871d74724e03acc3d73573783aae', 'request_id': 'req-ced0eaf6-b151-4c8b-ab58-39d053924790'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:36.066978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63bf871d74724e03acc3d73573783aae', 'request_id': 'req-ced0eaf6-b151-4c8b-ab58-39d053924790'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:36.068761 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:36.082605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] The token cache is being invalidate because project 63bf871d74724e03acc3d73573783aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:36.083247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:36.084162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ced0eaf6-b151-4c8b-ab58-39d053924790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:36.085955 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1153/2315] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:35 2022] DELETE /identity/v3/projects/63bf871d74724e03acc3d73573783aae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:36.091082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cc691-633b-4e87-895b-65ad7afa1d88 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.091557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cc691-633b-4e87-895b-65ad7afa1d88 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.091670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cc691-633b-4e87-895b-65ad7afa1d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.109371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-3c4cc691-633b-4e87-895b-65ad7afa1d88 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:36.110551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3c4cc691-633b-4e87-895b-65ad7afa1d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.167066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1163/2316] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:36.175076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897b36f-d955-4c5a-9d54-db30ecfdf02a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.175369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897b36f-d955-4c5a-9d54-db30ecfdf02a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.175651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897b36f-d955-4c5a-9d54-db30ecfdf02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.194261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-8897b36f-d955-4c5a-9d54-db30ecfdf02a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:36.195465 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8897b36f-d955-4c5a-9d54-db30ecfdf02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.203539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1154/2317] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:36.207480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cc691-633b-4e87-895b-65ad7afa1d88 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.217020 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cc691-633b-4e87-895b-65ad7afa1d88 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.221522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79127ff-2a4d-4d3e-bc4f-f9879144e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.222171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79127ff-2a4d-4d3e-bc4f-f9879144e2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.222459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79127ff-2a4d-4d3e-bc4f-f9879144e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.222740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79127ff-2a4d-4d3e-bc4f-f9879144e2a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.223984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79127ff-2a4d-4d3e-bc4f-f9879144e2a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:36.224321 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79127ff-2a4d-4d3e-bc4f-f9879144e2a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.225921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79127ff-2a4d-4d3e-bc4f-f9879144e2a7 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.237780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1164/2318] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:36.241932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897b36f-d955-4c5a-9d54-db30ecfdf02a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.260536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897b36f-d955-4c5a-9d54-db30ecfdf02a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.267243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e02b9b-ee63-4b44-bc8a-1238394cc3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.268180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e02b9b-ee63-4b44-bc8a-1238394cc3cd admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.268468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e02b9b-ee63-4b44-bc8a-1238394cc3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.268747 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e02b9b-ee63-4b44-bc8a-1238394cc3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.269471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e02b9b-ee63-4b44-bc8a-1238394cc3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.271983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e02b9b-ee63-4b44-bc8a-1238394cc3cd admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.304994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1155/2319] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:36 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:36.308536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79127ff-2a4d-4d3e-bc4f-f9879144e2a7 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.319746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79127ff-2a4d-4d3e-bc4f-f9879144e2a7 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.347030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:36.381651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356989a-9413-4add-8005-c9439021db09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.382330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356989a-9413-4add-8005-c9439021db09 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.382664 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356989a-9413-4add-8005-c9439021db09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.382945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356989a-9413-4add-8005-c9439021db09 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.383651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356989a-9413-4add-8005-c9439021db09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.385743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356989a-9413-4add-8005-c9439021db09 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.410743 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1165/2320] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:36 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:36.415133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e02b9b-ee63-4b44-bc8a-1238394cc3cd admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.428843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e02b9b-ee63-4b44-bc8a-1238394cc3cd admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.434401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca952edf-7c88-40fb-be1f-04e7d009675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.435306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca952edf-7c88-40fb-be1f-04e7d009675e admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.435599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca952edf-7c88-40fb-be1f-04e7d009675e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.436153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca952edf-7c88-40fb-be1f-04e7d009675e admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.436947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca952edf-7c88-40fb-be1f-04e7d009675e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.438601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca952edf-7c88-40fb-be1f-04e7d009675e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.454327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1156/2321] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:36.455591 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356989a-9413-4add-8005-c9439021db09 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.467481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356989a-9413-4add-8005-c9439021db09 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.473680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33361c8-2b2d-40a6-bbbf-a79e227fbea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.474785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33361c8-2b2d-40a6-bbbf-a79e227fbea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.475768 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33361c8-2b2d-40a6-bbbf-a79e227fbea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.476700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33361c8-2b2d-40a6-bbbf-a79e227fbea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.477845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33361c8-2b2d-40a6-bbbf-a79e227fbea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.480329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33361c8-2b2d-40a6-bbbf-a79e227fbea6 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.499799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1166/2322] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:36.500626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca952edf-7c88-40fb-be1f-04e7d009675e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.511047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca952edf-7c88-40fb-be1f-04e7d009675e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.515718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5321e-676f-42ae-92dd-9c6167f39972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.516705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5321e-676f-42ae-92dd-9c6167f39972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.516986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5321e-676f-42ae-92dd-9c6167f39972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.517264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5321e-676f-42ae-92dd-9c6167f39972 admin admin] PATH_INFO: `/v3/projects/c82e25e0940b4c2abbd71bd3032a4825/users/40a835515dd94db6a702778902f6be8f/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.540359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5321e-676f-42ae-92dd-9c6167f39972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82e25e0940b4c2abbd71bd3032a4825, user_id=40a835515dd94db6a702778902f6be8f, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.543029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5321e-676f-42ae-92dd-9c6167f39972 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.556530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1157/2323] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:36 2022] PUT /identity/v3/projects/c82e25e0940b4c2abbd71bd3032a4825/users/40a835515dd94db6a702778902f6be8f/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:36.561551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d83cb6-6e86-407a-9ad5-a7ab266646d9 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.561850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d83cb6-6e86-407a-9ad5-a7ab266646d9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.562137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d83cb6-6e86-407a-9ad5-a7ab266646d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.580868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-04d83cb6-6e86-407a-9ad5-a7ab266646d9 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:36.582094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-04d83cb6-6e86-407a-9ad5-a7ab266646d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.655618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1167/2324] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:36.661837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5321e-676f-42ae-92dd-9c6167f39972 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.663800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-aff5321e-676f-42ae-92dd-9c6167f39972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.742192 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5321e-676f-42ae-92dd-9c6167f39972 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.745867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6c55d-350b-4228-be35-53e9348f7bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.746520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6c55d-350b-4228-be35-53e9348f7bca service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.746801 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6c55d-350b-4228-be35-53e9348f7bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.747065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6c55d-350b-4228-be35-53e9348f7bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.757459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6c55d-350b-4228-be35-53e9348f7bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.758904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6c55d-350b-4228-be35-53e9348f7bca service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.777777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1158/2325] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:41.625355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf626-8720-4e49-b8cb-3f8931037a35 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.625923 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf626-8720-4e49-b8cb-3f8931037a35 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.625923 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abf626-8720-4e49-b8cb-3f8931037a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.659624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-97abf626-8720-4e49-b8cb-3f8931037a35 None None] MFA Rules not processed for user `40a835515dd94db6a702778902f6be8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:41.662257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-97abf626-8720-4e49-b8cb-3f8931037a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:41.805809 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1168/2326] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:41.812114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6c55d-350b-4228-be35-53e9348f7bca service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.847932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6c55d-350b-4228-be35-53e9348f7bca service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.861580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71825f2d-879a-46cd-b24a-e8cb8fdf3076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.862262 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71825f2d-879a-46cd-b24a-e8cb8fdf3076 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.862546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71825f2d-879a-46cd-b24a-e8cb8fdf3076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.862826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71825f2d-879a-46cd-b24a-e8cb8fdf3076 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.863524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71825f2d-879a-46cd-b24a-e8cb8fdf3076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.865985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71825f2d-879a-46cd-b24a-e8cb8fdf3076 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.925461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1159/2327] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:41 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:41.929967 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abf626-8720-4e49-b8cb-3f8931037a35 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.949168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abf626-8720-4e49-b8cb-3f8931037a35 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.027822 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:42.058042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ab922-f63d-42c2-af8c-8839e2de5887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.058385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab922-f63d-42c2-af8c-8839e2de5887 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.058817 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab922-f63d-42c2-af8c-8839e2de5887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.059102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab922-f63d-42c2-af8c-8839e2de5887 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.059805 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ab922-f63d-42c2-af8c-8839e2de5887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.061770 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ab922-f63d-42c2-af8c-8839e2de5887 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.097729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1169/2328] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:41 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:42.099867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71825f2d-879a-46cd-b24a-e8cb8fdf3076 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.111181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71825f2d-879a-46cd-b24a-e8cb8fdf3076 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.118074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c81f89-7217-4d26-b167-95067dd9ccde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.118774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c81f89-7217-4d26-b167-95067dd9ccde admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.119067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c81f89-7217-4d26-b167-95067dd9ccde admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.119349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c81f89-7217-4d26-b167-95067dd9ccde admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.120138 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c81f89-7217-4d26-b167-95067dd9ccde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.121776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c81f89-7217-4d26-b167-95067dd9ccde admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.139006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1160/2329] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:42.143462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ab922-f63d-42c2-af8c-8839e2de5887 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.154199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ab922-f63d-42c2-af8c-8839e2de5887 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.160459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c5433-3feb-47b2-b1cd-12c2fb5b7b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.166250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5433-3feb-47b2-b1cd-12c2fb5b7b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.166547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5433-3feb-47b2-b1cd-12c2fb5b7b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.166824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5433-3feb-47b2-b1cd-12c2fb5b7b6a admin admin] PATH_INFO: `/v3/projects/1ee9906f5d5c466a877b782ffc23d8e1/users/3f9226f418214e0584ea1458d0547952/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.183130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c5433-3feb-47b2-b1cd-12c2fb5b7b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee9906f5d5c466a877b782ffc23d8e1, user_id=3f9226f418214e0584ea1458d0547952, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.185856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c5433-3feb-47b2-b1cd-12c2fb5b7b6a admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.200461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1170/2330] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:42 2022] PUT /identity/v3/projects/1ee9906f5d5c466a877b782ffc23d8e1/users/3f9226f418214e0584ea1458d0547952/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:42.204470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c81f89-7217-4d26-b167-95067dd9ccde admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.220612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c81f89-7217-4d26-b167-95067dd9ccde admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.331701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922b32b-662c-4371-8776-25cc43389b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.332684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922b32b-662c-4371-8776-25cc43389b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.333625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922b32b-662c-4371-8776-25cc43389b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.334065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922b32b-662c-4371-8776-25cc43389b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.334967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922b32b-662c-4371-8776-25cc43389b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.351598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922b32b-662c-4371-8776-25cc43389b07 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.360329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:42.369327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1161/2331] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:42.372801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c5433-3feb-47b2-b1cd-12c2fb5b7b6a admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.388055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c5433-3feb-47b2-b1cd-12c2fb5b7b6a admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.393072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b26cd-5e55-49be-b841-f32bc9c34bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.393974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b26cd-5e55-49be-b841-f32bc9c34bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.394260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b26cd-5e55-49be-b841-f32bc9c34bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.394537 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b26cd-5e55-49be-b841-f32bc9c34bcc admin admin] PATH_INFO: `/v3/projects/1ee9906f5d5c466a877b782ffc23d8e1/users/3f9226f418214e0584ea1458d0547952/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.396574 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b26cd-5e55-49be-b841-f32bc9c34bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee9906f5d5c466a877b782ffc23d8e1, user_id=3f9226f418214e0584ea1458d0547952, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.399221 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b26cd-5e55-49be-b841-f32bc9c34bcc admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.410889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1171/2332] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:42 2022] PUT /identity/v3/projects/1ee9906f5d5c466a877b782ffc23d8e1/users/3f9226f418214e0584ea1458d0547952/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:47.827688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb761e-5899-4883-9821-a51050f28b9e None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.828228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb761e-5899-4883-9821-a51050f28b9e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.828422 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb761e-5899-4883-9821-a51050f28b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.860889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-82eb761e-5899-4883-9821-a51050f28b9e None None] MFA Rules not processed for user `3f9226f418214e0584ea1458d0547952`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:47.862178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-82eb761e-5899-4883-9821-a51050f28b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:47.940906 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1162/2333] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:47.954813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b26cd-5e55-49be-b841-f32bc9c34bcc admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:47.957830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-0d5b26cd-5e55-49be-b841-f32bc9c34bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:48.041896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b26cd-5e55-49be-b841-f32bc9c34bcc admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:48.047457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc083556-92e9-474a-a533-d5cdedac57b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:48.048151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc083556-92e9-474a-a533-d5cdedac57b1 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:48.048441 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc083556-92e9-474a-a533-d5cdedac57b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:48.048722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc083556-92e9-474a-a533-d5cdedac57b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:48.108979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc083556-92e9-474a-a533-d5cdedac57b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:48.110575 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc083556-92e9-474a-a533-d5cdedac57b1 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:48.120657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1172/2334] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:49.264027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2f430-92db-43f9-b2c6-f62933073a55 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:49.264529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2f430-92db-43f9-b2c6-f62933073a55 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:49.264628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2f430-92db-43f9-b2c6-f62933073a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:49.283087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-adc2f430-92db-43f9-b2c6-f62933073a55 None None] MFA Rules not processed for user `40a835515dd94db6a702778902f6be8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:49.284348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-adc2f430-92db-43f9-b2c6-f62933073a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:49.291385 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1163/2335] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:27:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:54.108260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc083556-92e9-474a-a533-d5cdedac57b1 service nova] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:54.109689 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-dc083556-92e9-474a-a533-d5cdedac57b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:54.140019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:54.215208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc083556-92e9-474a-a533-d5cdedac57b1 service nova] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:54.220489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ab9e3-26de-40e1-b096-eb7fbb78e7c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dde39c6d85446a681dea24573f0d6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:54.221144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ab9e3-26de-40e1-b096-eb7fbb78e7c1 service placement] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:54.221431 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ab9e3-26de-40e1-b096-eb7fbb78e7c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:54.221711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ab9e3-26de-40e1-b096-eb7fbb78e7c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:54.224155 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-de1ab9e3-26de-40e1-b096-eb7fbb78e7c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:54.236029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ab9e3-26de-40e1-b096-eb7fbb78e7c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:54.237622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ab9e3-26de-40e1-b096-eb7fbb78e7c1 service placement] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:54.248316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1173/2336] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:55.968850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c652ef-2b34-44e9-afb2-f35ece6a7b02 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:55.969344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c652ef-2b34-44e9-afb2-f35ece6a7b02 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:55.969570 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c652ef-2b34-44e9-afb2-f35ece6a7b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:56.027588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-21c652ef-2b34-44e9-afb2-f35ece6a7b02 None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:56.028856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-21c652ef-2b34-44e9-afb2-f35ece6a7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:56.094683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1164/2337] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 16 00:27:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:56.117229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ab9e3-26de-40e1-b096-eb7fbb78e7c1 service placement] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:56.118685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-de1ab9e3-26de-40e1-b096-eb7fbb78e7c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:56.211564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ab9e3-26de-40e1-b096-eb7fbb78e7c1 service placement] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:56.216783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a141aa-82b0-4252-b927-8be7829cfc9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:56.217437 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a141aa-82b0-4252-b927-8be7829cfc9e service swift] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:56.217728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a141aa-82b0-4252-b927-8be7829cfc9e service swift] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:56.218011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a141aa-82b0-4252-b927-8be7829cfc9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:56.228313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a141aa-82b0-4252-b927-8be7829cfc9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:56.229932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a141aa-82b0-4252-b927-8be7829cfc9e service swift] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:56.239158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1174/2338] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:27:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:28:06.091598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=79 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:06.235859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=71 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:20.089079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c652ef-2b34-44e9-afb2-f35ece6a7b02 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:20.090525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-21c652ef-2b34-44e9-afb2-f35ece6a7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:20.164386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c652ef-2b34-44e9-afb2-f35ece6a7b02 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:20.168236 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32807160-310f-461a-ae1d-f1240fa22246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:20.168973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32807160-310f-461a-ae1d-f1240fa22246 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:20.169336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32807160-310f-461a-ae1d-f1240fa22246 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:20.169983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32807160-310f-461a-ae1d-f1240fa22246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:20.179755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32807160-310f-461a-ae1d-f1240fa22246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:20.181357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32807160-310f-461a-ae1d-f1240fa22246 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:20.194284 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1165/2339] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:23.815110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f171bb-9b6c-4e0c-8431-97c28e73572d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.815686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f171bb-9b6c-4e0c-8431-97c28e73572d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.815686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f171bb-9b6c-4e0c-8431-97c28e73572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.835889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e7f171bb-9b6c-4e0c-8431-97c28e73572d None None] MFA Rules not processed for user `71cddd4efaaf4298934a4f601d746175`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:23.837146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e7f171bb-9b6c-4e0c-8431-97c28e73572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:23.896495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1175/2340] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:30.187898 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=26 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:33.889007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=25 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:43.730127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679cc73-918d-444e-853c-4be0ce11a886 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.730612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679cc73-918d-444e-853c-4be0ce11a886 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.730728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679cc73-918d-444e-853c-4be0ce11a886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.747804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-6679cc73-918d-444e-853c-4be0ce11a886 None None] MFA Rules not processed for user `8628dfd28dd641f88a53e9ff0da20d90`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:43.749009 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6679cc73-918d-444e-853c-4be0ce11a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:43.803248 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1166/2341] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:53.796251 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=25 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:55.495231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06584b-34ec-453f-98dc-d5bef34fbc39 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:55.495730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06584b-34ec-453f-98dc-d5bef34fbc39 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:55.495827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06584b-34ec-453f-98dc-d5bef34fbc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:55.513054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-bb06584b-34ec-453f-98dc-d5bef34fbc39 None None] MFA Rules not processed for user `f8dd78b473fc4b2bbe3d85471419f594`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:55.514251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bb06584b-34ec-453f-98dc-d5bef34fbc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:55.568230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1176/2342] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:28:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:05.561386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=25 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:10.913272 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc96ff-2f0d-4341-ad4d-e0ce264ed19d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:10.913754 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc96ff-2f0d-4341-ad4d-e0ce264ed19d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:10.913849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc96ff-2f0d-4341-ad4d-e0ce264ed19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:10.931218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7efc96ff-2f0d-4341-ad4d-e0ce264ed19d None None] MFA Rules not processed for user `fbc6b66ed796481abf4fdea66692f4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:10.932446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7efc96ff-2f0d-4341-ad4d-e0ce264ed19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:10.987508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1167/2343] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:29:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:20.980992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=25 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:33.312011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3a893-36fa-49cb-9e9b-d25ab87eda5f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:33.312540 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3a893-36fa-49cb-9e9b-d25ab87eda5f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:33.312644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3a893-36fa-49cb-9e9b-d25ab87eda5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:33.330589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-40e3a893-36fa-49cb-9e9b-d25ab87eda5f None None] MFA Rules not processed for user `71cddd4efaaf4298934a4f601d746175`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:33.331780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-40e3a893-36fa-49cb-9e9b-d25ab87eda5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:33.338577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1177/2344] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:29:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:43.324671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:52.051367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc96ff-2f0d-4341-ad4d-e0ce264ed19d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:52.061922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc96ff-2f0d-4341-ad4d-e0ce264ed19d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:52.065637 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa87b8-f820-463d-9d75-c7868eb504c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:52.066358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa87b8-f820-463d-9d75-c7868eb504c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:52.066652 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa87b8-f820-463d-9d75-c7868eb504c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:52.066935 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa87b8-f820-463d-9d75-c7868eb504c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:52.068836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-46aa87b8-f820-463d-9d75-c7868eb504c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:52.147186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa87b8-f820-463d-9d75-c7868eb504c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:52.148631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa87b8-f820-463d-9d75-c7868eb504c3 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:52.159264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1168/2345] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:54.042913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3a893-36fa-49cb-9e9b-d25ab87eda5f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.045234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-40e3a893-36fa-49cb-9e9b-d25ab87eda5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:54.059007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3a893-36fa-49cb-9e9b-d25ab87eda5f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.064161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42566faa-3fdf-4f00-8021-f9f19dd54503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.065038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566faa-3fdf-4f00-8021-f9f19dd54503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.065350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566faa-3fdf-4f00-8021-f9f19dd54503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.065628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566faa-3fdf-4f00-8021-f9f19dd54503 admin admin] PATH_INFO: `/v3/users/8628dfd28dd641f88a53e9ff0da20d90` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.066816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42566faa-3fdf-4f00-8021-f9f19dd54503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8628dfd28dd641f88a53e9ff0da20d90)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.068799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42566faa-3fdf-4f00-8021-f9f19dd54503 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.116378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-42566faa-3fdf-4f00-8021-f9f19dd54503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8628dfd28dd641f88a53e9ff0da20d90'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:54.116971 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-42566faa-3fdf-4f00-8021-f9f19dd54503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8628dfd28dd641f88a53e9ff0da20d90'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:54.129373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-42566faa-3fdf-4f00-8021-f9f19dd54503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8628dfd28dd641f88a53e9ff0da20d90'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:54.130013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-42566faa-3fdf-4f00-8021-f9f19dd54503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8628dfd28dd641f88a53e9ff0da20d90'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:54.137323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-42566faa-3fdf-4f00-8021-f9f19dd54503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8628dfd28dd641f88a53e9ff0da20d90'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:54.149464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1178/2346] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:54 2022] DELETE /identity/v3/users/8628dfd28dd641f88a53e9ff0da20d90 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:54.317104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa87b8-f820-463d-9d75-c7868eb504c3 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.329542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa87b8-f820-463d-9d75-c7868eb504c3 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.395016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.395882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.396196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.396476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] PATH_INFO: `/v3/projects/10f49f238af64943af0b38fbac6a131e` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.397643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f49f238af64943af0b38fbac6a131e)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.399547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.447355 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f49f238af64943af0b38fbac6a131e', 'request_id': 'req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:54.455954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f49f238af64943af0b38fbac6a131e', 'request_id': 'req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:54.462337 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f49f238af64943af0b38fbac6a131e', 'request_id': 'req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:54.473636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] The token cache is being invalidate because project 10f49f238af64943af0b38fbac6a131e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:54.473930 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:54.474582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-bf2fcc11-b22c-4f5d-85ce-7763a8e1e2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:54.476270 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1169/2347] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:54 2022] DELETE /identity/v3/projects/10f49f238af64943af0b38fbac6a131e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:54.481414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9339d-5fb0-4477-912e-a9530c9bdd2d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.481711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9339d-5fb0-4477-912e-a9530c9bdd2d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.481995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9339d-5fb0-4477-912e-a9530c9bdd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.501457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-9cd9339d-5fb0-4477-912e-a9530c9bdd2d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:54.502665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9cd9339d-5fb0-4477-912e-a9530c9bdd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:54.579557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1179/2348] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:54.587154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a725-2f3d-42f1-b72a-93ee113b42c9 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.587445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a725-2f3d-42f1-b72a-93ee113b42c9 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.587743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a725-2f3d-42f1-b72a-93ee113b42c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.606097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-78a6a725-2f3d-42f1-b72a-93ee113b42c9 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:54.608025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-78a6a725-2f3d-42f1-b72a-93ee113b42c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:54.616017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1170/2349] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:54.620359 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9339d-5fb0-4477-912e-a9530c9bdd2d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.631621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9339d-5fb0-4477-912e-a9530c9bdd2d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.636506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35956bea-b54e-4ade-bb8d-e5f09963d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.637168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35956bea-b54e-4ade-bb8d-e5f09963d9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.637456 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35956bea-b54e-4ade-bb8d-e5f09963d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.637731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35956bea-b54e-4ade-bb8d-e5f09963d9b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.638468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35956bea-b54e-4ade-bb8d-e5f09963d9b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:54.638805 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35956bea-b54e-4ade-bb8d-e5f09963d9b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.640552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35956bea-b54e-4ade-bb8d-e5f09963d9b3 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.652550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1180/2350] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:29:54.656845 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6a725-2f3d-42f1-b72a-93ee113b42c9 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.666808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6a725-2f3d-42f1-b72a-93ee113b42c9 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.673110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14f379-6dd4-4663-97f4-0051c2971d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.673809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f379-6dd4-4663-97f4-0051c2971d7e admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.674102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f379-6dd4-4663-97f4-0051c2971d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.674414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f379-6dd4-4663-97f4-0051c2971d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.675121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14f379-6dd4-4663-97f4-0051c2971d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.677087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14f379-6dd4-4663-97f4-0051c2971d7e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.692307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:54.707131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1171/2351] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:54 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:54.711295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35956bea-b54e-4ade-bb8d-e5f09963d9b3 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.722091 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35956bea-b54e-4ade-bb8d-e5f09963d9b3 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.780274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932bd3e-984a-428a-a29a-4da678b884ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.781095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932bd3e-984a-428a-a29a-4da678b884ec admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.781390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932bd3e-984a-428a-a29a-4da678b884ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.781673 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932bd3e-984a-428a-a29a-4da678b884ec admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.782376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932bd3e-984a-428a-a29a-4da678b884ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.784337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932bd3e-984a-428a-a29a-4da678b884ec admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.791137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:54.807679 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1181/2352] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:54 2022] POST /identity/v3/users => generated 281 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:54.812698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14f379-6dd4-4663-97f4-0051c2971d7e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.823172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14f379-6dd4-4663-97f4-0051c2971d7e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.828468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac8c40-10f6-4ca7-b807-49e974242a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.829207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac8c40-10f6-4ca7-b807-49e974242a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.829511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac8c40-10f6-4ca7-b807-49e974242a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.829791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac8c40-10f6-4ca7-b807-49e974242a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.830516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac8c40-10f6-4ca7-b807-49e974242a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.832141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac8c40-10f6-4ca7-b807-49e974242a90 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.844083 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1172/2353] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:54.848195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932bd3e-984a-428a-a29a-4da678b884ec admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.859027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932bd3e-984a-428a-a29a-4da678b884ec admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.864036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baca46b-1a1d-4783-a1b9-04fa47c130de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.864725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baca46b-1a1d-4783-a1b9-04fa47c130de admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.865005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baca46b-1a1d-4783-a1b9-04fa47c130de admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.865287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baca46b-1a1d-4783-a1b9-04fa47c130de admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.866032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baca46b-1a1d-4783-a1b9-04fa47c130de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.867684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baca46b-1a1d-4783-a1b9-04fa47c130de admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.879499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1182/2354] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:54.883748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac8c40-10f6-4ca7-b807-49e974242a90 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:54.897281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac8c40-10f6-4ca7-b807-49e974242a90 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:54.902145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719a742-ef4e-4e13-8de6-72671d358f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:54.903053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a742-ef4e-4e13-8de6-72671d358f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.903348 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a742-ef4e-4e13-8de6-72671d358f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.903628 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a742-ef4e-4e13-8de6-72671d358f37 admin admin] PATH_INFO: `/v3/projects/a936af6aa414460686ee4b9e92491f54/users/25d3ecbf784f4e8bb78ed1042976c602/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.919304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719a742-ef4e-4e13-8de6-72671d358f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a936af6aa414460686ee4b9e92491f54, user_id=25d3ecbf784f4e8bb78ed1042976c602, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:54.922071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719a742-ef4e-4e13-8de6-72671d358f37 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:54.937175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1173/2355] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:54 2022] PUT /identity/v3/projects/a936af6aa414460686ee4b9e92491f54/users/25d3ecbf784f4e8bb78ed1042976c602/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:54.947590 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad9c8-2bf0-4f92-8941-a34614e0bc59 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:54.947891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad9c8-2bf0-4f92-8941-a34614e0bc59 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:54.948213 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad9c8-2bf0-4f92-8941-a34614e0bc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:54.978848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a9cad9c8-2bf0-4f92-8941-a34614e0bc59 None None] MFA Rules not processed for user `25d3ecbf784f4e8bb78ed1042976c602`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:54.980130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a9cad9c8-2bf0-4f92-8941-a34614e0bc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:55.050813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1183/2356] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:29:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:55.055518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719a742-ef4e-4e13-8de6-72671d358f37 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:55.121093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719a742-ef4e-4e13-8de6-72671d358f37 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:55.126410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72160797-e9f0-47e3-a46c-384aaf113b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:55.127074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160797-e9f0-47e3-a46c-384aaf113b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:55.127356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160797-e9f0-47e3-a46c-384aaf113b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:55.127635 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160797-e9f0-47e3-a46c-384aaf113b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:55.128479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72160797-e9f0-47e3-a46c-384aaf113b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:55.130425 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72160797-e9f0-47e3-a46c-384aaf113b86 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:55.156239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1174/2357] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:55 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:55.160464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cad9c8-2bf0-4f92-8941-a34614e0bc59 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:55.171766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cad9c8-2bf0-4f92-8941-a34614e0bc59 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:55.230514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b149d-533d-4005-964c-ce4a113aa34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:55.231203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b149d-533d-4005-964c-ce4a113aa34c admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:55.231488 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b149d-533d-4005-964c-ce4a113aa34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:55.231777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b149d-533d-4005-964c-ce4a113aa34c admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:55.233130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b149d-533d-4005-964c-ce4a113aa34c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:55.235055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b149d-533d-4005-964c-ce4a113aa34c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:55.262562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1184/2358] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:55 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:55.264904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72160797-e9f0-47e3-a46c-384aaf113b86 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:55.277455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72160797-e9f0-47e3-a46c-384aaf113b86 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:55.282994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e94303-7084-44f5-9f65-0879af783f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:55.283668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e94303-7084-44f5-9f65-0879af783f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:55.283974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e94303-7084-44f5-9f65-0879af783f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:55.284282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e94303-7084-44f5-9f65-0879af783f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:55.285016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e94303-7084-44f5-9f65-0879af783f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:55.286625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e94303-7084-44f5-9f65-0879af783f74 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:55.298638 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1175/2359] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:55.302551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b149d-533d-4005-964c-ce4a113aa34c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:55.314635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b149d-533d-4005-964c-ce4a113aa34c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:55.320223 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b712-4567-468e-81ab-ff1d59c49d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:55.321361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b712-4567-468e-81ab-ff1d59c49d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:55.321939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b712-4567-468e-81ab-ff1d59c49d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:55.322091 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b712-4567-468e-81ab-ff1d59c49d7b admin admin] PATH_INFO: `/v3/projects/95913df991494afeb641281819f8e52b/users/14d4e8acbff24f6bbf8f6ca737acbfbc/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:55.338871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0b712-4567-468e-81ab-ff1d59c49d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95913df991494afeb641281819f8e52b, user_id=14d4e8acbff24f6bbf8f6ca737acbfbc, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:55.342252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0b712-4567-468e-81ab-ff1d59c49d7b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:55.360159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1185/2360] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:55 2022] PUT /identity/v3/projects/95913df991494afeb641281819f8e52b/users/14d4e8acbff24f6bbf8f6ca737acbfbc/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:55.362113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e94303-7084-44f5-9f65-0879af783f74 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:55.377293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e94303-7084-44f5-9f65-0879af783f74 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:55.436796 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baa3b1-4152-4f2e-892f-2af96fb82ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:55.437461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa3b1-4152-4f2e-892f-2af96fb82ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:55.437745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa3b1-4152-4f2e-892f-2af96fb82ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:55.438022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa3b1-4152-4f2e-892f-2af96fb82ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:55.438742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baa3b1-4152-4f2e-892f-2af96fb82ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:55.440368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baa3b1-4152-4f2e-892f-2af96fb82ed0 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:55.450351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1176/2361] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:55.454520 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b712-4567-468e-81ab-ff1d59c49d7b admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:55.464796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b712-4567-468e-81ab-ff1d59c49d7b admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:55.469926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbad76-80d6-467e-9034-c869a800f223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:55.470808 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbad76-80d6-467e-9034-c869a800f223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:55.471087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbad76-80d6-467e-9034-c869a800f223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:55.471362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbad76-80d6-467e-9034-c869a800f223 admin admin] PATH_INFO: `/v3/projects/95913df991494afeb641281819f8e52b/users/14d4e8acbff24f6bbf8f6ca737acbfbc/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:55.473345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbad76-80d6-467e-9034-c869a800f223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95913df991494afeb641281819f8e52b, user_id=14d4e8acbff24f6bbf8f6ca737acbfbc, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:55.475979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbad76-80d6-467e-9034-c869a800f223 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:55.488606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1186/2362] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:55 2022] PUT /identity/v3/projects/95913df991494afeb641281819f8e52b/users/14d4e8acbff24f6bbf8f6ca737acbfbc/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:55.500221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542952-3eed-47f6-9629-e5781b7f0ec9 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:55.500579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542952-3eed-47f6-9629-e5781b7f0ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:55.500874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542952-3eed-47f6-9629-e5781b7f0ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:55.528404 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e9542952-3eed-47f6-9629-e5781b7f0ec9 None None] MFA Rules not processed for user `14d4e8acbff24f6bbf8f6ca737acbfbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:55.530264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e9542952-3eed-47f6-9629-e5781b7f0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:55.551676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:55.593129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbad76-80d6-467e-9034-c869a800f223 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:55.594928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-73dbad76-80d6-467e-9034-c869a800f223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:55.606560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1177/2363] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:29:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:55.618099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9542952-3eed-47f6-9629-e5781b7f0ec9 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:55.618430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:55.619571 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e9542952-3eed-47f6-9629-e5781b7f0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:55.656561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbad76-80d6-467e-9034-c869a800f223 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:55.660682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3380b6-fea4-4df3-a28e-db8e0f9edc8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:55.661018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3380b6-fea4-4df3-a28e-db8e0f9edc8b service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:55.661305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3380b6-fea4-4df3-a28e-db8e0f9edc8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:55.661585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3380b6-fea4-4df3-a28e-db8e0f9edc8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:55.663424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9b3380b6-fea4-4df3-a28e-db8e0f9edc8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:55.700051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9542952-3eed-47f6-9629-e5781b7f0ec9 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:55.704413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0aec1-9538-46a4-8c0c-19d6aff652f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:55.705130 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0aec1-9538-46a4-8c0c-19d6aff652f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:55.705419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0aec1-9538-46a4-8c0c-19d6aff652f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:55.705693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0aec1-9538-46a4-8c0c-19d6aff652f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:55.714660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0aec1-9538-46a4-8c0c-19d6aff652f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:55.716114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0aec1-9538-46a4-8c0c-19d6aff652f6 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:55.725538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1178/2364] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:29:55.736986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3380b6-fea4-4df3-a28e-db8e0f9edc8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:55.738509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3380b6-fea4-4df3-a28e-db8e0f9edc8b service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:55.750902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1187/2365] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:55.796788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0aec1-9538-46a4-8c0c-19d6aff652f6 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:55.805541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0aec1-9538-46a4-8c0c-19d6aff652f6 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:55.809232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463ece-5160-483c-bce5-ee40412ff903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:55.809873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463ece-5160-483c-bce5-ee40412ff903 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:55.810160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463ece-5160-483c-bce5-ee40412ff903 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:55.810986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463ece-5160-483c-bce5-ee40412ff903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:55.876621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89463ece-5160-483c-bce5-ee40412ff903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:55.878142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89463ece-5160-483c-bce5-ee40412ff903 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:55.887252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1179/2366] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:56.933206 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3380b6-fea4-4df3-a28e-db8e0f9edc8b service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:56.942350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3380b6-fea4-4df3-a28e-db8e0f9edc8b service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:56.946332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1a71c-3223-4ad5-8c28-1daa9966020c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:56.946974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1a71c-3223-4ad5-8c28-1daa9966020c service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:56.947268 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1a71c-3223-4ad5-8c28-1daa9966020c service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:56.947547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1a71c-3223-4ad5-8c28-1daa9966020c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:56.949380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7ac1a71c-3223-4ad5-8c28-1daa9966020c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:56.963082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1a71c-3223-4ad5-8c28-1daa9966020c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:56.964553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1a71c-3223-4ad5-8c28-1daa9966020c service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:56.975806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1188/2367] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:58.574838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463ece-5160-483c-bce5-ee40412ff903 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:58.614918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:58.636579 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463ece-5160-483c-bce5-ee40412ff903 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:58.641733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:58.642603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.642890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.643166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] PATH_INFO: `/v3/users/25d3ecbf784f4e8bb78ed1042976c602` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.644371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d3ecbf784f4e8bb78ed1042976c602)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:58.646289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:58.691841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d3ecbf784f4e8bb78ed1042976c602'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:58.704562 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d3ecbf784f4e8bb78ed1042976c602'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:58.705244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d3ecbf784f4e8bb78ed1042976c602'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:58.712450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d3ecbf784f4e8bb78ed1042976c602'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:58.719242 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d3ecbf784f4e8bb78ed1042976c602'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:58.725207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1180/2368] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:58 2022] DELETE /identity/v3/users/25d3ecbf784f4e8bb78ed1042976c602 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:58.729915 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b414756-b6fd-4812-977e-b0a09984478b None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.730390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b414756-b6fd-4812-977e-b0a09984478b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.730638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b414756-b6fd-4812-977e-b0a09984478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.747140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4b414756-b6fd-4812-977e-b0a09984478b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:58.748865 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4b414756-b6fd-4812-977e-b0a09984478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:58.805051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1189/2369] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:58.814591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:58.816112 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:58.872331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78f4ce-fc05-42d0-81df-a142ceea6618 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:58.875940 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77af1f0-7294-4c7c-8ba3-6dd652d51084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:58.876608 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77af1f0-7294-4c7c-8ba3-6dd652d51084 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.876888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77af1f0-7294-4c7c-8ba3-6dd652d51084 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.877163 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77af1f0-7294-4c7c-8ba3-6dd652d51084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.886614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77af1f0-7294-4c7c-8ba3-6dd652d51084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:58.888086 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77af1f0-7294-4c7c-8ba3-6dd652d51084 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:58.898111 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1181/2370] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:29:59.159827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b414756-b6fd-4812-977e-b0a09984478b None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.161297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4b414756-b6fd-4812-977e-b0a09984478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:59.174245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b414756-b6fd-4812-977e-b0a09984478b None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.178824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.179713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.180015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.180476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] PATH_INFO: `/v3/projects/a936af6aa414460686ee4b9e92491f54` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.181682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a936af6aa414460686ee4b9e92491f54)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.183587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.227475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:59.231231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a936af6aa414460686ee4b9e92491f54', 'request_id': 'req-483cc1af-4811-495c-b9df-c1e66969c9cc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.238436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a936af6aa414460686ee4b9e92491f54', 'request_id': 'req-483cc1af-4811-495c-b9df-c1e66969c9cc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.244329 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a936af6aa414460686ee4b9e92491f54', 'request_id': 'req-483cc1af-4811-495c-b9df-c1e66969c9cc'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.256054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] The token cache is being invalidate because project a936af6aa414460686ee4b9e92491f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:59.256346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.256991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.258516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1190/2371] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:59 2022] DELETE /identity/v3/projects/a936af6aa414460686ee4b9e92491f54 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:29:59.262532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77af1f0-7294-4c7c-8ba3-6dd652d51084 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.273454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77af1f0-7294-4c7c-8ba3-6dd652d51084 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.333352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94bde6-b1f7-4fc5-bbc0-ce18aa7c9752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.334229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94bde6-b1f7-4fc5-bbc0-ce18aa7c9752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.334508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94bde6-b1f7-4fc5-bbc0-ce18aa7c9752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.334783 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94bde6-b1f7-4fc5-bbc0-ce18aa7c9752 admin admin] PATH_INFO: `/v3/users/14d4e8acbff24f6bbf8f6ca737acbfbc` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.335984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94bde6-b1f7-4fc5-bbc0-ce18aa7c9752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14d4e8acbff24f6bbf8f6ca737acbfbc)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.337907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94bde6-b1f7-4fc5-bbc0-ce18aa7c9752 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.339430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:59.387735 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-fd94bde6-b1f7-4fc5-bbc0-ce18aa7c9752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14d4e8acbff24f6bbf8f6ca737acbfbc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.401318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-fd94bde6-b1f7-4fc5-bbc0-ce18aa7c9752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14d4e8acbff24f6bbf8f6ca737acbfbc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.402157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-fd94bde6-b1f7-4fc5-bbc0-ce18aa7c9752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14d4e8acbff24f6bbf8f6ca737acbfbc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.409907 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-fd94bde6-b1f7-4fc5-bbc0-ce18aa7c9752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14d4e8acbff24f6bbf8f6ca737acbfbc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.417306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-fd94bde6-b1f7-4fc5-bbc0-ce18aa7c9752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14d4e8acbff24f6bbf8f6ca737acbfbc'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.423301 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1182/2372] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:59 2022] DELETE /identity/v3/users/14d4e8acbff24f6bbf8f6ca737acbfbc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:59.687435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.688995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:59.703042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cc1af-4811-495c-b9df-c1e66969c9cc admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.760034 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.760906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.761196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.761494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] PATH_INFO: `/v3/projects/95913df991494afeb641281819f8e52b` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.762690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95913df991494afeb641281819f8e52b)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.765169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.810270 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95913df991494afeb641281819f8e52b', 'request_id': 'req-4bcead6e-c074-44da-b7cd-3bd656c23f98'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.818684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95913df991494afeb641281819f8e52b', 'request_id': 'req-4bcead6e-c074-44da-b7cd-3bd656c23f98'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.824711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95913df991494afeb641281819f8e52b', 'request_id': 'req-4bcead6e-c074-44da-b7cd-3bd656c23f98'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.835882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] The token cache is being invalidate because project 95913df991494afeb641281819f8e52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:59.836196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.836819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-4bcead6e-c074-44da-b7cd-3bd656c23f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:59.838325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1191/2373] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:59 2022] DELETE /identity/v3/projects/95913df991494afeb641281819f8e52b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:59.843639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c4900-2812-407f-95e5-0a703ea60e21 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.844131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c4900-2812-407f-95e5-0a703ea60e21 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.844230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c4900-2812-407f-95e5-0a703ea60e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.861032 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-e44c4900-2812-407f-95e5-0a703ea60e21 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:59.862227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e44c4900-2812-407f-95e5-0a703ea60e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:59.923521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1183/2374] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:59.931356 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bfad1-4fdb-4e02-b37a-610a0e88fcd5 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.931656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bfad1-4fdb-4e02-b37a-610a0e88fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.931941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bfad1-4fdb-4e02-b37a-610a0e88fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.950429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-528bfad1-4fdb-4e02-b37a-610a0e88fcd5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:59.951658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-528bfad1-4fdb-4e02-b37a-610a0e88fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:59.959498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1192/2375] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:59.963399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c4900-2812-407f-95e5-0a703ea60e21 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.973543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c4900-2812-407f-95e5-0a703ea60e21 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.978081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651e17-66a9-46ac-a9e5-43e21c9a6e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.978730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651e17-66a9-46ac-a9e5-43e21c9a6e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.979016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651e17-66a9-46ac-a9e5-43e21c9a6e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.979297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651e17-66a9-46ac-a9e5-43e21c9a6e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.980053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef651e17-66a9-46ac-a9e5-43e21c9a6e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:59.980366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef651e17-66a9-46ac-a9e5-43e21c9a6e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.981959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef651e17-66a9-46ac-a9e5-43e21c9a6e45 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.993449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1184/2376] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:29:59.997548 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bfad1-4fdb-4e02-b37a-610a0e88fcd5 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.007202 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bfad1-4fdb-4e02-b37a-610a0e88fcd5 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.011747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe5980-65a7-49db-826b-7aa9dd545d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.012489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe5980-65a7-49db-826b-7aa9dd545d24 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.012774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe5980-65a7-49db-826b-7aa9dd545d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.013048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe5980-65a7-49db-826b-7aa9dd545d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.014335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe5980-65a7-49db-826b-7aa9dd545d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.016271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe5980-65a7-49db-826b-7aa9dd545d24 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.042517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1193/2377] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:59 2022] POST /identity/v3/projects => generated 409 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:00.045555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651e17-66a9-46ac-a9e5-43e21c9a6e45 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.055390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651e17-66a9-46ac-a9e5-43e21c9a6e45 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.109949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b8e3-e499-49de-9817-1e097881a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.110616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b8e3-e499-49de-9817-1e097881a047 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.110904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b8e3-e499-49de-9817-1e097881a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.111191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b8e3-e499-49de-9817-1e097881a047 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.112048 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522b8e3-e499-49de-9817-1e097881a047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.113967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522b8e3-e499-49de-9817-1e097881a047 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.123822 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:00.135172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1185/2378] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:00 2022] POST /identity/v3/users => generated 305 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:00.139360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe5980-65a7-49db-826b-7aa9dd545d24 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.149446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe5980-65a7-49db-826b-7aa9dd545d24 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.154441 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63574838-baea-4c47-aeb3-9ed3b82fd7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.155095 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574838-baea-4c47-aeb3-9ed3b82fd7ad admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.155379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574838-baea-4c47-aeb3-9ed3b82fd7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.155658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63574838-baea-4c47-aeb3-9ed3b82fd7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.156420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63574838-baea-4c47-aeb3-9ed3b82fd7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.158019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63574838-baea-4c47-aeb3-9ed3b82fd7ad admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.168177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1194/2379] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:00.172471 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b8e3-e499-49de-9817-1e097881a047 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.182418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b8e3-e499-49de-9817-1e097881a047 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.187099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de336bce-0579-4f51-b104-f4743b20b40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.187755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de336bce-0579-4f51-b104-f4743b20b40e admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.188076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de336bce-0579-4f51-b104-f4743b20b40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.188396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de336bce-0579-4f51-b104-f4743b20b40e admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.189116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de336bce-0579-4f51-b104-f4743b20b40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.190712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de336bce-0579-4f51-b104-f4743b20b40e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.200950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1186/2380] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:00.204813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63574838-baea-4c47-aeb3-9ed3b82fd7ad admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.214620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63574838-baea-4c47-aeb3-9ed3b82fd7ad admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.219711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0db3b9-6a3e-4ec7-95d1-1cf700d7ba5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.220619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0db3b9-6a3e-4ec7-95d1-1cf700d7ba5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.220906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0db3b9-6a3e-4ec7-95d1-1cf700d7ba5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.221189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0db3b9-6a3e-4ec7-95d1-1cf700d7ba5a admin admin] PATH_INFO: `/v3/projects/9a012471d3bb479a915042bed5da5bea/users/106cfe9e4c8745adbc9ad175cbe2b808/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.237202 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0db3b9-6a3e-4ec7-95d1-1cf700d7ba5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a012471d3bb479a915042bed5da5bea, user_id=106cfe9e4c8745adbc9ad175cbe2b808, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.239902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0db3b9-6a3e-4ec7-95d1-1cf700d7ba5a admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.247992 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:00.254264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1195/2381] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:00 2022] PUT /identity/v3/projects/9a012471d3bb479a915042bed5da5bea/users/106cfe9e4c8745adbc9ad175cbe2b808/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:00.264461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d5fdd-855c-4bf7-98ae-fc861153093f None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.264778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d5fdd-855c-4bf7-98ae-fc861153093f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.265064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d5fdd-855c-4bf7-98ae-fc861153093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.291048 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d39d5fdd-855c-4bf7-98ae-fc861153093f None None] MFA Rules not processed for user `106cfe9e4c8745adbc9ad175cbe2b808`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:00.292312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d39d5fdd-855c-4bf7-98ae-fc861153093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:00.354692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1187/2382] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:00 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:00.359654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0db3b9-6a3e-4ec7-95d1-1cf700d7ba5a admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.419598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0db3b9-6a3e-4ec7-95d1-1cf700d7ba5a admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.424191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82499f7-890b-4c12-b708-0f09407bf6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.424871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82499f7-890b-4c12-b708-0f09407bf6ba admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.425154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82499f7-890b-4c12-b708-0f09407bf6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.425429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82499f7-890b-4c12-b708-0f09407bf6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.426124 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82499f7-890b-4c12-b708-0f09407bf6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.428046 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82499f7-890b-4c12-b708-0f09407bf6ba admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.456740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1196/2383] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:00 2022] POST /identity/v3/projects => generated 407 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:00.457852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d5fdd-855c-4bf7-98ae-fc861153093f None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.469312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d5fdd-855c-4bf7-98ae-fc861153093f None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.526902 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7482bae-a27a-4b8f-8e6b-70ae11118e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.527578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7482bae-a27a-4b8f-8e6b-70ae11118e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.527866 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7482bae-a27a-4b8f-8e6b-70ae11118e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.528177 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7482bae-a27a-4b8f-8e6b-70ae11118e55 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.528895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7482bae-a27a-4b8f-8e6b-70ae11118e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.531387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7482bae-a27a-4b8f-8e6b-70ae11118e55 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.554557 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1188/2384] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:00 2022] POST /identity/v3/users => generated 310 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:00.555741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82499f7-890b-4c12-b708-0f09407bf6ba admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.565855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82499f7-890b-4c12-b708-0f09407bf6ba admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.573351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b74ce5-a953-45ac-a4c1-bd2d3d2f45b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.574054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b74ce5-a953-45ac-a4c1-bd2d3d2f45b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.574365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b74ce5-a953-45ac-a4c1-bd2d3d2f45b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.574647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b74ce5-a953-45ac-a4c1-bd2d3d2f45b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.575376 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b74ce5-a953-45ac-a4c1-bd2d3d2f45b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.577524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b74ce5-a953-45ac-a4c1-bd2d3d2f45b9 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.588447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1197/2385] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:00.593201 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7482bae-a27a-4b8f-8e6b-70ae11118e55 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.603226 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7482bae-a27a-4b8f-8e6b-70ae11118e55 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.608507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59730659-c1fd-4e9b-85b7-2432393a7699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.609465 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59730659-c1fd-4e9b-85b7-2432393a7699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.609814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59730659-c1fd-4e9b-85b7-2432393a7699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.610150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59730659-c1fd-4e9b-85b7-2432393a7699 admin admin] PATH_INFO: `/v3/projects/a70c21f07da5486698d3c9c4246deada/users/ed02690dce1440a1ba043b7aebbffc80/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.625660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59730659-c1fd-4e9b-85b7-2432393a7699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70c21f07da5486698d3c9c4246deada, user_id=ed02690dce1440a1ba043b7aebbffc80, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.628367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59730659-c1fd-4e9b-85b7-2432393a7699 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.641605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1189/2386] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:00 2022] PUT /identity/v3/projects/a70c21f07da5486698d3c9c4246deada/users/ed02690dce1440a1ba043b7aebbffc80/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:00.645697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b74ce5-a953-45ac-a4c1-bd2d3d2f45b9 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.656224 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b74ce5-a953-45ac-a4c1-bd2d3d2f45b9 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.710732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35303cc-0f16-4bdf-8e8e-029ae373f0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.711327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35303cc-0f16-4bdf-8e8e-029ae373f0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.711624 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35303cc-0f16-4bdf-8e8e-029ae373f0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.711899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35303cc-0f16-4bdf-8e8e-029ae373f0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.712660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35303cc-0f16-4bdf-8e8e-029ae373f0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.714254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35303cc-0f16-4bdf-8e8e-029ae373f0c6 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.723857 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1198/2387] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:30:00.727994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59730659-c1fd-4e9b-85b7-2432393a7699 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.738162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59730659-c1fd-4e9b-85b7-2432393a7699 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.742794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d77ae-a16e-454c-80da-982922842072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.743664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d77ae-a16e-454c-80da-982922842072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.743946 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d77ae-a16e-454c-80da-982922842072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.744255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d77ae-a16e-454c-80da-982922842072 admin admin] PATH_INFO: `/v3/projects/a70c21f07da5486698d3c9c4246deada/users/ed02690dce1440a1ba043b7aebbffc80/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.746217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d77ae-a16e-454c-80da-982922842072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70c21f07da5486698d3c9c4246deada, user_id=ed02690dce1440a1ba043b7aebbffc80, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.749441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d77ae-a16e-454c-80da-982922842072 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.759395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1190/2388] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:00 2022] PUT /identity/v3/projects/a70c21f07da5486698d3c9c4246deada/users/ed02690dce1440a1ba043b7aebbffc80/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:00.770927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5f2bf-d294-4c93-b707-ef52a839178f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.771407 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5f2bf-d294-4c93-b707-ef52a839178f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.771501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5f2bf-d294-4c93-b707-ef52a839178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.798356 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-d4a5f2bf-d294-4c93-b707-ef52a839178f None None] MFA Rules not processed for user `ed02690dce1440a1ba043b7aebbffc80`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:00.799567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d4a5f2bf-d294-4c93-b707-ef52a839178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:00.857986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:00.869247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1199/2389] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:00 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:00.880311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d77ae-a16e-454c-80da-982922842072 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.882010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-fe1d77ae-a16e-454c-80da-982922842072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:00.913366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:00.941956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d77ae-a16e-454c-80da-982922842072 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.945899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255e7a1-e194-4296-a159-4dcf7bf2f205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.946548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255e7a1-e194-4296-a159-4dcf7bf2f205 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.946842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255e7a1-e194-4296-a159-4dcf7bf2f205 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.947118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255e7a1-e194-4296-a159-4dcf7bf2f205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.956721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255e7a1-e194-4296-a159-4dcf7bf2f205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.958157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255e7a1-e194-4296-a159-4dcf7bf2f205 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.967498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1191/2390] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:00 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:01.111850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5f2bf-d294-4c93-b707-ef52a839178f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:01.121319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5f2bf-d294-4c93-b707-ef52a839178f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:01.124899 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341041d-6f8b-44b0-87bd-9a8080a3cf0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:01.125533 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341041d-6f8b-44b0-87bd-9a8080a3cf0a service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:01.125816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341041d-6f8b-44b0-87bd-9a8080a3cf0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:01.126111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341041d-6f8b-44b0-87bd-9a8080a3cf0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:01.180204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341041d-6f8b-44b0-87bd-9a8080a3cf0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:01.181705 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341041d-6f8b-44b0-87bd-9a8080a3cf0a service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:01.190612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1200/2391] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:06.451605 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255e7a1-e194-4296-a159-4dcf7bf2f205 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:06.513782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255e7a1-e194-4296-a159-4dcf7bf2f205 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:06.518357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:06.519225 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:06.519513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:06.519792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] PATH_INFO: `/v3/users/106cfe9e4c8745adbc9ad175cbe2b808` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:06.521031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106cfe9e4c8745adbc9ad175cbe2b808)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:06.523049 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:06.568188 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106cfe9e4c8745adbc9ad175cbe2b808'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:06.580179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106cfe9e4c8745adbc9ad175cbe2b808'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:06.580827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106cfe9e4c8745adbc9ad175cbe2b808'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:06.587868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106cfe9e4c8745adbc9ad175cbe2b808'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:06.594585 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106cfe9e4c8745adbc9ad175cbe2b808'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:06.600294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1192/2392] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:06 2022] DELETE /identity/v3/users/106cfe9e4c8745adbc9ad175cbe2b808 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:06.604865 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cf056-1e3a-42e6-a312-15e848d340ad None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:06.605337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cf056-1e3a-42e6-a312-15e848d340ad None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:06.605446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cf056-1e3a-42e6-a312-15e848d340ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:06.623424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f15cf056-1e3a-42e6-a312-15e848d340ad None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:06.624672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f15cf056-1e3a-42e6-a312-15e848d340ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:06.681255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1201/2393] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:06.691450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:06.692915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:06.745648 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:06.749451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fd386-19c4-48cd-901f-ef97bf766a60 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:06.754129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374dc0c-4a8b-4a71-ae1e-622f47980a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:06.754838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374dc0c-4a8b-4a71-ae1e-622f47980a0c service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:06.755337 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374dc0c-4a8b-4a71-ae1e-622f47980a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:06.755811 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374dc0c-4a8b-4a71-ae1e-622f47980a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:06.765106 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374dc0c-4a8b-4a71-ae1e-622f47980a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:06.766530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374dc0c-4a8b-4a71-ae1e-622f47980a0c service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:06.775930 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1193/2394] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:07.034459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cf056-1e3a-42e6-a312-15e848d340ad None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:07.035883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f15cf056-1e3a-42e6-a312-15e848d340ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:07.055534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cf056-1e3a-42e6-a312-15e848d340ad None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:07.061311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:07.061937 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.062242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.062466 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] PATH_INFO: `/v3/projects/9a012471d3bb479a915042bed5da5bea` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.063727 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a012471d3bb479a915042bed5da5bea)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:07.065674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:07.117618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a012471d3bb479a915042bed5da5bea', 'request_id': 'req-77eba6ce-2878-4430-af0f-8ca66a7f6f02'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.127045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a012471d3bb479a915042bed5da5bea', 'request_id': 'req-77eba6ce-2878-4430-af0f-8ca66a7f6f02'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.133854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a012471d3bb479a915042bed5da5bea', 'request_id': 'req-77eba6ce-2878-4430-af0f-8ca66a7f6f02'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.146671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] The token cache is being invalidate because project 9a012471d3bb479a915042bed5da5bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:07.147013 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.147761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.149446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1202/2395] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:07 2022] DELETE /identity/v3/projects/9a012471d3bb479a915042bed5da5bea => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:07.153573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374dc0c-4a8b-4a71-ae1e-622f47980a0c service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:07.165148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374dc0c-4a8b-4a71-ae1e-622f47980a0c service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:07.224793 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caab0bf-6582-4dec-a9e1-f178cfc48a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:07.225702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caab0bf-6582-4dec-a9e1-f178cfc48a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.225968 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caab0bf-6582-4dec-a9e1-f178cfc48a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.226253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caab0bf-6582-4dec-a9e1-f178cfc48a17 admin admin] PATH_INFO: `/v3/users/ed02690dce1440a1ba043b7aebbffc80` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.227454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caab0bf-6582-4dec-a9e1-f178cfc48a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed02690dce1440a1ba043b7aebbffc80)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:07.229425 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caab0bf-6582-4dec-a9e1-f178cfc48a17 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:07.279947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6caab0bf-6582-4dec-a9e1-f178cfc48a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed02690dce1440a1ba043b7aebbffc80'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.293084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6caab0bf-6582-4dec-a9e1-f178cfc48a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed02690dce1440a1ba043b7aebbffc80'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.293852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6caab0bf-6582-4dec-a9e1-f178cfc48a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed02690dce1440a1ba043b7aebbffc80'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.302550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6caab0bf-6582-4dec-a9e1-f178cfc48a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed02690dce1440a1ba043b7aebbffc80'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.315127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-6caab0bf-6582-4dec-a9e1-f178cfc48a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed02690dce1440a1ba043b7aebbffc80'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.321357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1194/2396] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:07 2022] DELETE /identity/v3/users/ed02690dce1440a1ba043b7aebbffc80 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:07.666324 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:07.667804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:07.681702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eba6ce-2878-4430-af0f-8ca66a7f6f02 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:07.694732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:07.744283 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:07.745162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.745452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.745728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] PATH_INFO: `/v3/projects/a70c21f07da5486698d3c9c4246deada` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.746938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70c21f07da5486698d3c9c4246deada)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:07.748929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:07.793464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70c21f07da5486698d3c9c4246deada', 'request_id': 'req-6666ef28-a66c-4485-96f1-bff8352b5b1b'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.800953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70c21f07da5486698d3c9c4246deada', 'request_id': 'req-6666ef28-a66c-4485-96f1-bff8352b5b1b'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.806411 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70c21f07da5486698d3c9c4246deada', 'request_id': 'req-6666ef28-a66c-4485-96f1-bff8352b5b1b'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.817270 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] The token cache is being invalidate because project a70c21f07da5486698d3c9c4246deada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:07.817554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.818170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6666ef28-a66c-4485-96f1-bff8352b5b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.820132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1203/2397] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:07 2022] DELETE /identity/v3/projects/a70c21f07da5486698d3c9c4246deada => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:07.825094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9af9a-be96-4222-b61d-a15a8763a0be None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.826062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9af9a-be96-4222-b61d-a15a8763a0be None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.826176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9af9a-be96-4222-b61d-a15a8763a0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.843901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-07b9af9a-be96-4222-b61d-a15a8763a0be None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:07.845120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-07b9af9a-be96-4222-b61d-a15a8763a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:07.904393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1195/2398] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:07.912289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ab8f-eb4e-4f3e-818d-311e5efc30d9 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.912524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ab8f-eb4e-4f3e-818d-311e5efc30d9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.912802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663ab8f-eb4e-4f3e-818d-311e5efc30d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.930825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b663ab8f-eb4e-4f3e-818d-311e5efc30d9 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:07.932059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b663ab8f-eb4e-4f3e-818d-311e5efc30d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:07.939864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1204/2399] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:07.943818 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9af9a-be96-4222-b61d-a15a8763a0be None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:07.954099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9af9a-be96-4222-b61d-a15a8763a0be None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:07.958658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da630480-3bf0-4f87-92a6-bd8c3fd201e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:07.959320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da630480-3bf0-4f87-92a6-bd8c3fd201e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.959602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da630480-3bf0-4f87-92a6-bd8c3fd201e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.959881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da630480-3bf0-4f87-92a6-bd8c3fd201e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.960639 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da630480-3bf0-4f87-92a6-bd8c3fd201e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:30:07.960950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da630480-3bf0-4f87-92a6-bd8c3fd201e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:07.962587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da630480-3bf0-4f87-92a6-bd8c3fd201e8 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:07.970107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:07.977599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1196/2400] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:30:07.981294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663ab8f-eb4e-4f3e-818d-311e5efc30d9 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:07.990557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663ab8f-eb4e-4f3e-818d-311e5efc30d9 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:07.995187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5a0d-07db-4bd7-9d19-eae5a8074383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:07.995873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5a0d-07db-4bd7-9d19-eae5a8074383 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.996190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5a0d-07db-4bd7-9d19-eae5a8074383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.996472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5a0d-07db-4bd7-9d19-eae5a8074383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.997188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be5a0d-07db-4bd7-9d19-eae5a8074383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:07.999103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be5a0d-07db-4bd7-9d19-eae5a8074383 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.030082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1205/2401] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:07 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:08.034267 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da630480-3bf0-4f87-92a6-bd8c3fd201e8 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.044177 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da630480-3bf0-4f87-92a6-bd8c3fd201e8 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.098403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672ff12-41f9-4912-ba98-701a7b43583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.099061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672ff12-41f9-4912-ba98-701a7b43583a admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.099344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672ff12-41f9-4912-ba98-701a7b43583a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.099619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672ff12-41f9-4912-ba98-701a7b43583a admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.100339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672ff12-41f9-4912-ba98-701a7b43583a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.102279 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672ff12-41f9-4912-ba98-701a7b43583a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.121255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1197/2402] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:08 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:08.125500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5a0d-07db-4bd7-9d19-eae5a8074383 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.135649 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5a0d-07db-4bd7-9d19-eae5a8074383 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.140717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03362-0464-49fe-af1c-35193f5a4246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.141370 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03362-0464-49fe-af1c-35193f5a4246 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.141654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03362-0464-49fe-af1c-35193f5a4246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.141933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03362-0464-49fe-af1c-35193f5a4246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.142657 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b03362-0464-49fe-af1c-35193f5a4246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.144275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b03362-0464-49fe-af1c-35193f5a4246 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.156059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1206/2403] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:08.159734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672ff12-41f9-4912-ba98-701a7b43583a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.169520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672ff12-41f9-4912-ba98-701a7b43583a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.174002 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54955837-ccda-4e15-9ef2-cf0d588aeda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.174655 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955837-ccda-4e15-9ef2-cf0d588aeda3 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.174937 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955837-ccda-4e15-9ef2-cf0d588aeda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.175215 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955837-ccda-4e15-9ef2-cf0d588aeda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.175933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54955837-ccda-4e15-9ef2-cf0d588aeda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.177576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54955837-ccda-4e15-9ef2-cf0d588aeda3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.187754 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1198/2404] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:08.191469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03362-0464-49fe-af1c-35193f5a4246 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.201929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03362-0464-49fe-af1c-35193f5a4246 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.206469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4e700-f4ad-4e61-b7b6-0ff9a04eeae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.207331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4e700-f4ad-4e61-b7b6-0ff9a04eeae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.207613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4e700-f4ad-4e61-b7b6-0ff9a04eeae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.207903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4e700-f4ad-4e61-b7b6-0ff9a04eeae5 admin admin] PATH_INFO: `/v3/projects/d021ee6cfb0f4d0f8b6066888c8ce579/users/95ca53c71f5249838bb4c7bd8fec7b77/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.221910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4e700-f4ad-4e61-b7b6-0ff9a04eeae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d021ee6cfb0f4d0f8b6066888c8ce579, user_id=95ca53c71f5249838bb4c7bd8fec7b77, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.224678 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4e700-f4ad-4e61-b7b6-0ff9a04eeae5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.237182 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1207/2405] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:08 2022] PUT /identity/v3/projects/d021ee6cfb0f4d0f8b6066888c8ce579/users/95ca53c71f5249838bb4c7bd8fec7b77/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:08.247852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c57c09-47ee-4c7f-80c6-caaa79e02b99 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.248181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c57c09-47ee-4c7f-80c6-caaa79e02b99 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.248464 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c57c09-47ee-4c7f-80c6-caaa79e02b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.279923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-64c57c09-47ee-4c7f-80c6-caaa79e02b99 None None] MFA Rules not processed for user `95ca53c71f5249838bb4c7bd8fec7b77`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:08.281183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-64c57c09-47ee-4c7f-80c6-caaa79e02b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:08.348070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1199/2406] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:08.352749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4e700-f4ad-4e61-b7b6-0ff9a04eeae5 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.410018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:08.431682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4e700-f4ad-4e61-b7b6-0ff9a04eeae5 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.437032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7706f30-3b01-4666-9f73-460854678439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.437693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7706f30-3b01-4666-9f73-460854678439 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.437976 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7706f30-3b01-4666-9f73-460854678439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.438254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7706f30-3b01-4666-9f73-460854678439 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.439426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7706f30-3b01-4666-9f73-460854678439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.441761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7706f30-3b01-4666-9f73-460854678439 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.469852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1208/2407] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:08 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:08.473873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c57c09-47ee-4c7f-80c6-caaa79e02b99 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.485888 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c57c09-47ee-4c7f-80c6-caaa79e02b99 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.541379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6295d-815a-455a-aae1-542cdd1603f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.542050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6295d-815a-455a-aae1-542cdd1603f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.542338 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6295d-815a-455a-aae1-542cdd1603f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.542619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6295d-815a-455a-aae1-542cdd1603f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.543316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6295d-815a-455a-aae1-542cdd1603f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.545302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6295d-815a-455a-aae1-542cdd1603f0 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.554543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:08.565997 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1200/2408] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:08 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:30:08.570301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7706f30-3b01-4666-9f73-460854678439 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.584421 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7706f30-3b01-4666-9f73-460854678439 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.589713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19a4cd-c9db-4c60-96cd-4875e755d52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.590395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19a4cd-c9db-4c60-96cd-4875e755d52c admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.590683 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19a4cd-c9db-4c60-96cd-4875e755d52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.590966 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19a4cd-c9db-4c60-96cd-4875e755d52c admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.591695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19a4cd-c9db-4c60-96cd-4875e755d52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.593331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19a4cd-c9db-4c60-96cd-4875e755d52c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.604280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1209/2409] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:30:08.608931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6295d-815a-455a-aae1-542cdd1603f0 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.618928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6295d-815a-455a-aae1-542cdd1603f0 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.624356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c7356-2fce-430c-b67a-e6a8e267def5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.625240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7356-2fce-430c-b67a-e6a8e267def5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.625523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7356-2fce-430c-b67a-e6a8e267def5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.625799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c7356-2fce-430c-b67a-e6a8e267def5 admin admin] PATH_INFO: `/v3/projects/5e8ad7dd05bc4c209788ec5d8b0effc0/users/6ea185a270d341199072db7a98613907/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.640277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c7356-2fce-430c-b67a-e6a8e267def5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8ad7dd05bc4c209788ec5d8b0effc0, user_id=6ea185a270d341199072db7a98613907, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.642900 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c7356-2fce-430c-b67a-e6a8e267def5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.657412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1201/2410] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:08 2022] PUT /identity/v3/projects/5e8ad7dd05bc4c209788ec5d8b0effc0/users/6ea185a270d341199072db7a98613907/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:08.661465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19a4cd-c9db-4c60-96cd-4875e755d52c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.671945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19a4cd-c9db-4c60-96cd-4875e755d52c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.729207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8571fa6-1600-4da4-a179-cdcfdbe2445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.729998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8571fa6-1600-4da4-a179-cdcfdbe2445b admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.730295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8571fa6-1600-4da4-a179-cdcfdbe2445b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.730578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8571fa6-1600-4da4-a179-cdcfdbe2445b admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.731306 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8571fa6-1600-4da4-a179-cdcfdbe2445b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.733431 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8571fa6-1600-4da4-a179-cdcfdbe2445b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.744145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1210/2411] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:08.748998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c7356-2fce-430c-b67a-e6a8e267def5 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.759929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c7356-2fce-430c-b67a-e6a8e267def5 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.764532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f9e79-787b-4da5-8f81-402b02734bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.765418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9e79-787b-4da5-8f81-402b02734bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.765702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9e79-787b-4da5-8f81-402b02734bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.765980 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f9e79-787b-4da5-8f81-402b02734bf3 admin admin] PATH_INFO: `/v3/projects/5e8ad7dd05bc4c209788ec5d8b0effc0/users/6ea185a270d341199072db7a98613907/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.767999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f9e79-787b-4da5-8f81-402b02734bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8ad7dd05bc4c209788ec5d8b0effc0, user_id=6ea185a270d341199072db7a98613907, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.770636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f9e79-787b-4da5-8f81-402b02734bf3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.781576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1202/2412] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:08 2022] PUT /identity/v3/projects/5e8ad7dd05bc4c209788ec5d8b0effc0/users/6ea185a270d341199072db7a98613907/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:08.799541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7601c-870c-4f5f-b55c-f9409babac7b None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.799751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7601c-870c-4f5f-b55c-f9409babac7b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.800048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7601c-870c-4f5f-b55c-f9409babac7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.829707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-56e7601c-870c-4f5f-b55c-f9409babac7b None None] MFA Rules not processed for user `6ea185a270d341199072db7a98613907`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:08.830931 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-56e7601c-870c-4f5f-b55c-f9409babac7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:08.904957 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1211/2413] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:08.915977 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f9e79-787b-4da5-8f81-402b02734bf3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.917732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-247f9e79-787b-4da5-8f81-402b02734bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:08.975212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f9e79-787b-4da5-8f81-402b02734bf3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.978824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd104ec-d735-45a2-a133-e0e4f0563549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.979505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd104ec-d735-45a2-a133-e0e4f0563549 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.979795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd104ec-d735-45a2-a133-e0e4f0563549 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.980115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd104ec-d735-45a2-a133-e0e4f0563549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.040636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd104ec-d735-45a2-a133-e0e4f0563549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:09.042071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd104ec-d735-45a2-a133-e0e4f0563549 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:09.051089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1203/2414] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:11.066632 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7601c-870c-4f5f-b55c-f9409babac7b None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:11.068137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-56e7601c-870c-4f5f-b55c-f9409babac7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:11.113135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:11.148831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7601c-870c-4f5f-b55c-f9409babac7b None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:11.155332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0c753-362c-48e5-8fb1-21cdd6394273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:11.156620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c753-362c-48e5-8fb1-21cdd6394273 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:11.156922 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c753-362c-48e5-8fb1-21cdd6394273 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:11.157204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c753-362c-48e5-8fb1-21cdd6394273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:11.160490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-63b0c753-362c-48e5-8fb1-21cdd6394273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:11.223289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0c753-362c-48e5-8fb1-21cdd6394273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:11.225015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0c753-362c-48e5-8fb1-21cdd6394273 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:11.234282 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1212/2415] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:13.180344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd104ec-d735-45a2-a133-e0e4f0563549 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:13.188923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd104ec-d735-45a2-a133-e0e4f0563549 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:13.192524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4c94-80ec-433e-a5f3-ddaa828931e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:13.193158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4c94-80ec-433e-a5f3-ddaa828931e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:13.193444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4c94-80ec-433e-a5f3-ddaa828931e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:13.193721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4c94-80ec-433e-a5f3-ddaa828931e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:13.203243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c4c94-80ec-433e-a5f3-ddaa828931e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:13.204697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c4c94-80ec-433e-a5f3-ddaa828931e6 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:13.213970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1204/2416] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:13.572967 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab2bf-802b-4137-b1a0-e2f647a64344 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:13.573521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab2bf-802b-4137-b1a0-e2f647a64344 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:13.573521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab2bf-802b-4137-b1a0-e2f647a64344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:13.596217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c3bab2bf-802b-4137-b1a0-e2f647a64344 None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:13.599853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c3bab2bf-802b-4137-b1a0-e2f647a64344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:13.670929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1213/2417] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:30:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:13.726197 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4c94-80ec-433e-a5f3-ddaa828931e6 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:13.728668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-183c4c94-80ec-433e-a5f3-ddaa828931e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:13.802901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:13.808959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4c94-80ec-433e-a5f3-ddaa828931e6 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:13.815338 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f35ed-2ea9-4a1a-8073-e414737ca81a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:13.816045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f35ed-2ea9-4a1a-8073-e414737ca81a service swift] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:13.816490 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f35ed-2ea9-4a1a-8073-e414737ca81a service swift] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:13.816637 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f35ed-2ea9-4a1a-8073-e414737ca81a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:13.827306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f35ed-2ea9-4a1a-8073-e414737ca81a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:13.829260 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f35ed-2ea9-4a1a-8073-e414737ca81a service swift] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:13.839733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1205/2418] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:30:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:30:18.309266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bab2bf-802b-4137-b1a0-e2f647a64344 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:18.387912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bab2bf-802b-4137-b1a0-e2f647a64344 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:18.392653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:18.393609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:18.394009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:18.394297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] PATH_INFO: `/v3/users/95ca53c71f5249838bb4c7bd8fec7b77` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:18.395498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ca53c71f5249838bb4c7bd8fec7b77)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:18.397466 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:18.423467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:18.455910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ca53c71f5249838bb4c7bd8fec7b77'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:18.456542 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ca53c71f5249838bb4c7bd8fec7b77'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:18.470549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ca53c71f5249838bb4c7bd8fec7b77'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:18.471269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ca53c71f5249838bb4c7bd8fec7b77'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:18.480637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ca53c71f5249838bb4c7bd8fec7b77'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:18.494049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1214/2419] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:18 2022] DELETE /identity/v3/users/95ca53c71f5249838bb4c7bd8fec7b77 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:18.499995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84acb3-138f-49b2-bce8-58801d510ea1 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:18.502772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84acb3-138f-49b2-bce8-58801d510ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:18.503299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84acb3-138f-49b2-bce8-58801d510ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:18.527020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-fb84acb3-138f-49b2-bce8-58801d510ea1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:18.529544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-fb84acb3-138f-49b2-bce8-58801d510ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:18.602263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1206/2420] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:18.613494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:18.615001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:18.699506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57b79-8899-4326-a339-2e48232616c6 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:18.704840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236dfe9-403a-4e83-bdb7-5a095fd14b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:18.704840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236dfe9-403a-4e83-bdb7-5a095fd14b08 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:18.704840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236dfe9-403a-4e83-bdb7-5a095fd14b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:18.704840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236dfe9-403a-4e83-bdb7-5a095fd14b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:18.718077 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236dfe9-403a-4e83-bdb7-5a095fd14b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:18.719540 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236dfe9-403a-4e83-bdb7-5a095fd14b08 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:18.730689 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1215/2421] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:19.048683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84acb3-138f-49b2-bce8-58801d510ea1 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:19.050717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-fb84acb3-138f-49b2-bce8-58801d510ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:19.066085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84acb3-138f-49b2-bce8-58801d510ea1 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:19.072769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:19.073951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:19.074439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:19.075661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] PATH_INFO: `/v3/projects/d021ee6cfb0f4d0f8b6066888c8ce579` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:19.077810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d021ee6cfb0f4d0f8b6066888c8ce579)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:19.089403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:19.163859 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd021ee6cfb0f4d0f8b6066888c8ce579', 'request_id': 'req-f40bae09-7b1f-46dc-ad72-73a959abbaa1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:19.176971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd021ee6cfb0f4d0f8b6066888c8ce579', 'request_id': 'req-f40bae09-7b1f-46dc-ad72-73a959abbaa1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:19.187503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd021ee6cfb0f4d0f8b6066888c8ce579', 'request_id': 'req-f40bae09-7b1f-46dc-ad72-73a959abbaa1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:19.204873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] The token cache is being invalidate because project d021ee6cfb0f4d0f8b6066888c8ce579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:19.205186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:19.205983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:19.207902 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1207/2422] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:19 2022] DELETE /identity/v3/projects/d021ee6cfb0f4d0f8b6066888c8ce579 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:19.211804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236dfe9-403a-4e83-bdb7-5a095fd14b08 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:19.223794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236dfe9-403a-4e83-bdb7-5a095fd14b08 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:19.315603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52c743-3274-471c-8442-f9d73f06ea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:19.316588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52c743-3274-471c-8442-f9d73f06ea32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:19.316878 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52c743-3274-471c-8442-f9d73f06ea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:19.317165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52c743-3274-471c-8442-f9d73f06ea32 admin admin] PATH_INFO: `/v3/users/6ea185a270d341199072db7a98613907` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:19.318396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52c743-3274-471c-8442-f9d73f06ea32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea185a270d341199072db7a98613907)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:19.321060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52c743-3274-471c-8442-f9d73f06ea32 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:19.429289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:19.439563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fc52c743-3274-471c-8442-f9d73f06ea32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea185a270d341199072db7a98613907'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:19.440628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fc52c743-3274-471c-8442-f9d73f06ea32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea185a270d341199072db7a98613907'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:19.463158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fc52c743-3274-471c-8442-f9d73f06ea32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea185a270d341199072db7a98613907'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:19.464680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fc52c743-3274-471c-8442-f9d73f06ea32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea185a270d341199072db7a98613907'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:19.487733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fc52c743-3274-471c-8442-f9d73f06ea32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea185a270d341199072db7a98613907'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:19.531538 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1216/2423] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:19 2022] DELETE /identity/v3/users/6ea185a270d341199072db7a98613907 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:20.084391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:20.085966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:20.115255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bae09-7b1f-46dc-ad72-73a959abbaa1 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:20.279792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:20.280918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:20.281386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:20.281821 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] PATH_INFO: `/v3/projects/5e8ad7dd05bc4c209788ec5d8b0effc0` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:20.283255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8ad7dd05bc4c209788ec5d8b0effc0)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:20.285532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:20.316959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:20.401567 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8ad7dd05bc4c209788ec5d8b0effc0', 'request_id': 'req-07815ba0-95ad-4129-a1c7-91f5938b931a'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:20.423616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8ad7dd05bc4c209788ec5d8b0effc0', 'request_id': 'req-07815ba0-95ad-4129-a1c7-91f5938b931a'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:20.438250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8ad7dd05bc4c209788ec5d8b0effc0', 'request_id': 'req-07815ba0-95ad-4129-a1c7-91f5938b931a'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:20.463369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] The token cache is being invalidate because project 5e8ad7dd05bc4c209788ec5d8b0effc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:20.463668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:20.464452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-07815ba0-95ad-4129-a1c7-91f5938b931a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:20.466408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1208/2424] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:20 2022] DELETE /identity/v3/projects/5e8ad7dd05bc4c209788ec5d8b0effc0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:20.472945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9d955-b1c8-46d7-9178-4ff796d2cb18 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:20.475021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9d955-b1c8-46d7-9178-4ff796d2cb18 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:20.475510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9d955-b1c8-46d7-9178-4ff796d2cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:20.506972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-5fc9d955-b1c8-46d7-9178-4ff796d2cb18 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:20.509103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5fc9d955-b1c8-46d7-9178-4ff796d2cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:20.596239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1217/2425] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:20.600271 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b86e9-7682-4a82-8654-1323a1839f7b None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:20.600852 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b86e9-7682-4a82-8654-1323a1839f7b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:20.601322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b86e9-7682-4a82-8654-1323a1839f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:20.632233 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-f04b86e9-7682-4a82-8654-1323a1839f7b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:20.637373 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f04b86e9-7682-4a82-8654-1323a1839f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:20.663485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1209/2426] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:20.665775 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9d955-b1c8-46d7-9178-4ff796d2cb18 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:20.677194 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9d955-b1c8-46d7-9178-4ff796d2cb18 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:20.687767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585ef98-cb03-4471-a15c-cd9030e4cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:20.688505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585ef98-cb03-4471-a15c-cd9030e4cfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:20.688792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585ef98-cb03-4471-a15c-cd9030e4cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:20.689070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585ef98-cb03-4471-a15c-cd9030e4cfc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:20.689806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585ef98-cb03-4471-a15c-cd9030e4cfc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:30:20.690120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585ef98-cb03-4471-a15c-cd9030e4cfc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:20.691861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585ef98-cb03-4471-a15c-cd9030e4cfc3 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:20.723975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1218/2427] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:30:20.729586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b86e9-7682-4a82-8654-1323a1839f7b None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:20.741674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b86e9-7682-4a82-8654-1323a1839f7b None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:20.757794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038b3fd-5da0-40c1-b249-e4508581a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:20.758538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038b3fd-5da0-40c1-b249-e4508581a3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:20.758830 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038b3fd-5da0-40c1-b249-e4508581a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:20.759116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038b3fd-5da0-40c1-b249-e4508581a3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:20.759899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038b3fd-5da0-40c1-b249-e4508581a3d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:20.761885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038b3fd-5da0-40c1-b249-e4508581a3d1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:20.809440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1210/2428] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:20 2022] POST /identity/v3/projects => generated 361 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:20.814580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585ef98-cb03-4471-a15c-cd9030e4cfc3 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:20.834552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585ef98-cb03-4471-a15c-cd9030e4cfc3 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:20.914400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bbf26-57c6-4469-9d23-816989e1b15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:20.915461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bbf26-57c6-4469-9d23-816989e1b15e admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:20.915461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bbf26-57c6-4469-9d23-816989e1b15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:20.915760 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bbf26-57c6-4469-9d23-816989e1b15e admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:20.916585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bbf26-57c6-4469-9d23-816989e1b15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:20.919079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bbf26-57c6-4469-9d23-816989e1b15e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:20.947688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1219/2429] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:20 2022] POST /identity/v3/users => generated 281 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:20.949144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038b3fd-5da0-40c1-b249-e4508581a3d1 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:20.961394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038b3fd-5da0-40c1-b249-e4508581a3d1 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:20.967882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e63e88-e988-403d-891f-b3a81d8f0c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:20.968591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e63e88-e988-403d-891f-b3a81d8f0c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:20.968874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e63e88-e988-403d-891f-b3a81d8f0c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:20.969145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e63e88-e988-403d-891f-b3a81d8f0c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:20.969878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e63e88-e988-403d-891f-b3a81d8f0c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:20.972065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e63e88-e988-403d-891f-b3a81d8f0c89 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:20.984599 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1211/2430] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:20.988188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bbf26-57c6-4469-9d23-816989e1b15e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:20.999453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bbf26-57c6-4469-9d23-816989e1b15e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:21.004360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6966d-63fd-44ef-b0af-471762837507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:21.005078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6966d-63fd-44ef-b0af-471762837507 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:21.005366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6966d-63fd-44ef-b0af-471762837507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:21.005650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6966d-63fd-44ef-b0af-471762837507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:21.007423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6966d-63fd-44ef-b0af-471762837507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:21.008589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6966d-63fd-44ef-b0af-471762837507 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:21.030042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e63e88-e988-403d-891f-b3a81d8f0c89 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:21.030966 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1220/2431] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:21.047586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e63e88-e988-403d-891f-b3a81d8f0c89 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:21.052982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710ae58-a359-452c-a2b6-e8dc0fd3995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:21.053915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710ae58-a359-452c-a2b6-e8dc0fd3995e admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:21.054218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710ae58-a359-452c-a2b6-e8dc0fd3995e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:21.054505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710ae58-a359-452c-a2b6-e8dc0fd3995e admin admin] PATH_INFO: `/v3/projects/89dfc2829a444b0c931b575e1691d8fc/users/c632427e9e34464f8496836b4563c347/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:21.073230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710ae58-a359-452c-a2b6-e8dc0fd3995e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89dfc2829a444b0c931b575e1691d8fc, user_id=c632427e9e34464f8496836b4563c347, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:21.077701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710ae58-a359-452c-a2b6-e8dc0fd3995e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:21.109721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1212/2432] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:21 2022] PUT /identity/v3/projects/89dfc2829a444b0c931b575e1691d8fc/users/c632427e9e34464f8496836b4563c347/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:21.122222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3292c-2d6d-47f9-9c15-dec84991e1f9 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:21.122553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3292c-2d6d-47f9-9c15-dec84991e1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:21.122855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3292c-2d6d-47f9-9c15-dec84991e1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:21.154793 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-92f3292c-2d6d-47f9-9c15-dec84991e1f9 None None] MFA Rules not processed for user `c632427e9e34464f8496836b4563c347`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:21.154974 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-92f3292c-2d6d-47f9-9c15-dec84991e1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:21.169010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:21.252023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1221/2433] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:21.280565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710ae58-a359-452c-a2b6-e8dc0fd3995e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:21.282349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0710ae58-a359-452c-a2b6-e8dc0fd3995e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:21.353689 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710ae58-a359-452c-a2b6-e8dc0fd3995e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:21.358519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596b652-5f30-479c-9d76-d95f81980850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:21.359194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596b652-5f30-479c-9d76-d95f81980850 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:21.359578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596b652-5f30-479c-9d76-d95f81980850 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:21.359871 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596b652-5f30-479c-9d76-d95f81980850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:21.371238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596b652-5f30-479c-9d76-d95f81980850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:21.373295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596b652-5f30-479c-9d76-d95f81980850 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:21.385665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1213/2434] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:21.403240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3292c-2d6d-47f9-9c15-dec84991e1f9 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:21.492377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3292c-2d6d-47f9-9c15-dec84991e1f9 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:21.498268 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:21.500919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:21.501220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:21.501505 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] PATH_INFO: `/v3/users/c632427e9e34464f8496836b4563c347` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:21.502773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c632427e9e34464f8496836b4563c347)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:21.504910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:21.565097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c632427e9e34464f8496836b4563c347'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:21.565800 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c632427e9e34464f8496836b4563c347'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:21.580725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c632427e9e34464f8496836b4563c347'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:21.581475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c632427e9e34464f8496836b4563c347'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:21.591294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c632427e9e34464f8496836b4563c347'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:21.612736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c3a7-f9b0-4b10-9aa5-e8cf2406cc26 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:21.613057 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c3a7-f9b0-4b10-9aa5-e8cf2406cc26 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:21.613345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c3a7-f9b0-4b10-9aa5-e8cf2406cc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:21.619874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1222/2435] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:21 2022] DELETE /identity/v3/users/c632427e9e34464f8496836b4563c347 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:21.636740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-b4d2c3a7-f9b0-4b10-9aa5-e8cf2406cc26 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:21.639053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b4d2c3a7-f9b0-4b10-9aa5-e8cf2406cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:21.702265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:21.730552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1214/2436] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:21.743432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:21.745072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:21.771131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2c3a7-f9b0-4b10-9aa5-e8cf2406cc26 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:21.773222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b4d2c3a7-f9b0-4b10-9aa5-e8cf2406cc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:21.794936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:21.820455 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08746849-b783-4c16-ae65-d93ff3930043 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:21.824463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaf185-cd0f-4682-a00f-71cd7596a30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:21.825185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf185-cd0f-4682-a00f-71cd7596a30f service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:21.825476 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf185-cd0f-4682-a00f-71cd7596a30f service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:21.825758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaf185-cd0f-4682-a00f-71cd7596a30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:21.842275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eaf185-cd0f-4682-a00f-71cd7596a30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:21.843728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eaf185-cd0f-4682-a00f-71cd7596a30f service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:21.858084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1223/2437] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:21.900964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2c3a7-f9b0-4b10-9aa5-e8cf2406cc26 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:21.911908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7303548-0934-4aab-a430-2afa2793c55e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:21.912651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7303548-0934-4aab-a430-2afa2793c55e service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:21.912938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7303548-0934-4aab-a430-2afa2793c55e service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:21.913220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7303548-0934-4aab-a430-2afa2793c55e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:21.920226 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e7303548-0934-4aab-a430-2afa2793c55e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:21.992902 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7303548-0934-4aab-a430-2afa2793c55e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:21.994722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7303548-0934-4aab-a430-2afa2793c55e service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:22.007806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1215/2438] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:30:22.218910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaf185-cd0f-4682-a00f-71cd7596a30f service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:22.220391 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-84eaf185-cd0f-4682-a00f-71cd7596a30f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:22.246764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaf185-cd0f-4682-a00f-71cd7596a30f service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:22.254378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:22.255258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:22.255541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:22.255813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] PATH_INFO: `/v3/projects/89dfc2829a444b0c931b575e1691d8fc` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:22.257824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89dfc2829a444b0c931b575e1691d8fc)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:22.259751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:22.382458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89dfc2829a444b0c931b575e1691d8fc', 'request_id': 'req-e01c0122-61f1-47d6-a31c-92a52ec15b01'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:22.404994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89dfc2829a444b0c931b575e1691d8fc', 'request_id': 'req-e01c0122-61f1-47d6-a31c-92a52ec15b01'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:22.424258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89dfc2829a444b0c931b575e1691d8fc', 'request_id': 'req-e01c0122-61f1-47d6-a31c-92a52ec15b01'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:22.448020 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] The token cache is being invalidate because project 89dfc2829a444b0c931b575e1691d8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:22.448334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:22.453680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-e01c0122-61f1-47d6-a31c-92a52ec15b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:22.459341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1224/2439] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:22 2022] DELETE /identity/v3/projects/89dfc2829a444b0c931b575e1691d8fc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:22.461695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b080c8-6351-430b-a910-47861266c6f0 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:22.462803 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b080c8-6351-430b-a910-47861266c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:22.464779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b080c8-6351-430b-a910-47861266c6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:22.515278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-66b080c8-6351-430b-a910-47861266c6f0 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:22.516671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-66b080c8-6351-430b-a910-47861266c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:22.616700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575afbe7-7674-48da-9970-ea920f2ec5c0 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:22.617229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575afbe7-7674-48da-9970-ea920f2ec5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:22.617323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575afbe7-7674-48da-9970-ea920f2ec5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:22.624113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1216/2440] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:22.641835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-575afbe7-7674-48da-9970-ea920f2ec5c0 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:22.643063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-575afbe7-7674-48da-9970-ea920f2ec5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:22.659946 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b080c8-6351-430b-a910-47861266c6f0 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:22.678292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1225/2441] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:22.679617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b080c8-6351-430b-a910-47861266c6f0 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:22.685707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77c933-7f68-4a67-a6d9-3b7e6bd336c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:22.686388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77c933-7f68-4a67-a6d9-3b7e6bd336c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:22.686787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77c933-7f68-4a67-a6d9-3b7e6bd336c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:22.687076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77c933-7f68-4a67-a6d9-3b7e6bd336c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:22.688827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77c933-7f68-4a67-a6d9-3b7e6bd336c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:30:22.689026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77c933-7f68-4a67-a6d9-3b7e6bd336c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:22.691748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77c933-7f68-4a67-a6d9-3b7e6bd336c5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:22.712938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575afbe7-7674-48da-9970-ea920f2ec5c0 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:22.722601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1217/2442] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:30:22.725096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575afbe7-7674-48da-9970-ea920f2ec5c0 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:22.730641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56b017-2974-4c48-94af-7ca4a177204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:22.731514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56b017-2974-4c48-94af-7ca4a177204f admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:22.731802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56b017-2974-4c48-94af-7ca4a177204f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:22.732117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56b017-2974-4c48-94af-7ca4a177204f admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:22.732826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56b017-2974-4c48-94af-7ca4a177204f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:22.735203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56b017-2974-4c48-94af-7ca4a177204f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:22.798477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77c933-7f68-4a67-a6d9-3b7e6bd336c5 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:22.807557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1226/2443] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:22 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:30:22.821417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77c933-7f68-4a67-a6d9-3b7e6bd336c5 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:22.843561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:23.001792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba757c-6686-492d-81dc-3f36b13ddf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:23.002481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba757c-6686-492d-81dc-3f36b13ddf5a admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:23.002773 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba757c-6686-492d-81dc-3f36b13ddf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:23.003053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba757c-6686-492d-81dc-3f36b13ddf5a admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:23.003748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba757c-6686-492d-81dc-3f36b13ddf5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:23.007517 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba757c-6686-492d-81dc-3f36b13ddf5a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:23.058220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1218/2444] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:22 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:23.063180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56b017-2974-4c48-94af-7ca4a177204f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:23.102770 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56b017-2974-4c48-94af-7ca4a177204f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:23.110855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b3688-770a-4752-be01-9bf3650478c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:23.113566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b3688-770a-4752-be01-9bf3650478c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:23.113566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b3688-770a-4752-be01-9bf3650478c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:23.113566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b3688-770a-4752-be01-9bf3650478c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:23.117303 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b3688-770a-4752-be01-9bf3650478c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:23.119151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b3688-770a-4752-be01-9bf3650478c6 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:23.140747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1227/2445] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:23.144797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba757c-6686-492d-81dc-3f36b13ddf5a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:23.156223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba757c-6686-492d-81dc-3f36b13ddf5a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:23.163376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd18a8-a3e4-4814-9694-3ff48aefb03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:23.164088 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd18a8-a3e4-4814-9694-3ff48aefb03f admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:23.164381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd18a8-a3e4-4814-9694-3ff48aefb03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:23.164669 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd18a8-a3e4-4814-9694-3ff48aefb03f admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:23.165408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd18a8-a3e4-4814-9694-3ff48aefb03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:23.167103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd18a8-a3e4-4814-9694-3ff48aefb03f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:23.180355 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1219/2446] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:23.184399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b3688-770a-4752-be01-9bf3650478c6 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:23.195556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b3688-770a-4752-be01-9bf3650478c6 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:23.201832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b018aba-0dd4-4658-b115-5ed5ba60b823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:23.203205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018aba-0dd4-4658-b115-5ed5ba60b823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:23.203500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018aba-0dd4-4658-b115-5ed5ba60b823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:23.203783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018aba-0dd4-4658-b115-5ed5ba60b823 admin admin] PATH_INFO: `/v3/projects/c2642988ee614f88bd15e29044a3e954/users/1a1a1027fdf149a9826ad8602b190676/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:23.225826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b018aba-0dd4-4658-b115-5ed5ba60b823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2642988ee614f88bd15e29044a3e954, user_id=1a1a1027fdf149a9826ad8602b190676, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:23.228721 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b018aba-0dd4-4658-b115-5ed5ba60b823 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:23.248063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1228/2447] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:23 2022] PUT /identity/v3/projects/c2642988ee614f88bd15e29044a3e954/users/1a1a1027fdf149a9826ad8602b190676/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:23.256519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453a70-1250-4990-a7e7-65fe51ff7b55 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:23.257110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453a70-1250-4990-a7e7-65fe51ff7b55 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:23.257624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453a70-1250-4990-a7e7-65fe51ff7b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:23.288904 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-f3453a70-1250-4990-a7e7-65fe51ff7b55 None None] MFA Rules not processed for user `1a1a1027fdf149a9826ad8602b190676`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:23.290146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f3453a70-1250-4990-a7e7-65fe51ff7b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:23.375838 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1220/2448] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:23.380759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b018aba-0dd4-4658-b115-5ed5ba60b823 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:23.456130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:23.470385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b018aba-0dd4-4658-b115-5ed5ba60b823 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:23.476002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ac9d3-3aa0-4a1a-b566-3621f1556425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:23.477351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ac9d3-3aa0-4a1a-b566-3621f1556425 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:23.477635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ac9d3-3aa0-4a1a-b566-3621f1556425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:23.477913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ac9d3-3aa0-4a1a-b566-3621f1556425 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:23.478889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ac9d3-3aa0-4a1a-b566-3621f1556425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:23.481065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ac9d3-3aa0-4a1a-b566-3621f1556425 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:23.511423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1229/2449] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:23 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:23.512578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453a70-1250-4990-a7e7-65fe51ff7b55 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:23.524407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453a70-1250-4990-a7e7-65fe51ff7b55 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:23.591158 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abbf8c-d903-4eba-b053-ad4a1c71847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:23.591843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abbf8c-d903-4eba-b053-ad4a1c71847b admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:23.592165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abbf8c-d903-4eba-b053-ad4a1c71847b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:23.592439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abbf8c-d903-4eba-b053-ad4a1c71847b admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:23.593134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abbf8c-d903-4eba-b053-ad4a1c71847b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:23.595059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abbf8c-d903-4eba-b053-ad4a1c71847b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:23.623396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1221/2450] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:23 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:30:23.626940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ac9d3-3aa0-4a1a-b566-3621f1556425 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:23.640825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ac9d3-3aa0-4a1a-b566-3621f1556425 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:23.648496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad2b21-2cdd-4e37-af84-2463f9169c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:23.650830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2b21-2cdd-4e37-af84-2463f9169c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:23.651130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2b21-2cdd-4e37-af84-2463f9169c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:23.651417 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad2b21-2cdd-4e37-af84-2463f9169c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:23.655706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad2b21-2cdd-4e37-af84-2463f9169c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:23.659446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad2b21-2cdd-4e37-af84-2463f9169c58 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:23.675472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1230/2451] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:30:23.679435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abbf8c-d903-4eba-b053-ad4a1c71847b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:23.687771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:23.692340 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abbf8c-d903-4eba-b053-ad4a1c71847b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:23.698693 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08435f7b-c214-4640-839a-bf63f56af0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:23.700223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08435f7b-c214-4640-839a-bf63f56af0df admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:23.701323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08435f7b-c214-4640-839a-bf63f56af0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:23.702031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08435f7b-c214-4640-839a-bf63f56af0df admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:23.703652 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08435f7b-c214-4640-839a-bf63f56af0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:23.705871 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08435f7b-c214-4640-839a-bf63f56af0df admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:23.721105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1222/2452] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:23.725393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad2b21-2cdd-4e37-af84-2463f9169c58 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:23.736939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad2b21-2cdd-4e37-af84-2463f9169c58 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:23.742426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4c800-3072-4191-a95f-4c08675006f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:23.743606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4c800-3072-4191-a95f-4c08675006f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:23.744010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4c800-3072-4191-a95f-4c08675006f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:23.744373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4c800-3072-4191-a95f-4c08675006f3 admin admin] PATH_INFO: `/v3/projects/0d6bd9d0e56342f2ab5082beff045742/users/da2a3c25b1b14340bb6447d95959cee7/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:23.760773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4c800-3072-4191-a95f-4c08675006f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6bd9d0e56342f2ab5082beff045742, user_id=da2a3c25b1b14340bb6447d95959cee7, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:23.764071 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4c800-3072-4191-a95f-4c08675006f3 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:23.789963 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1231/2453] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:23 2022] PUT /identity/v3/projects/0d6bd9d0e56342f2ab5082beff045742/users/da2a3c25b1b14340bb6447d95959cee7/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:23.801604 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3cac-a9d7-4be6-9ea9-da7772393c05 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:23.801893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3cac-a9d7-4be6-9ea9-da7772393c05 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:23.802172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3cac-a9d7-4be6-9ea9-da7772393c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:23.830347 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-72bc3cac-a9d7-4be6-9ea9-da7772393c05 None None] MFA Rules not processed for user `da2a3c25b1b14340bb6447d95959cee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:23.831687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-72bc3cac-a9d7-4be6-9ea9-da7772393c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:23.919337 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1223/2454] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:23.924365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4c800-3072-4191-a95f-4c08675006f3 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:24.000684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4c800-3072-4191-a95f-4c08675006f3 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:24.009684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e6bd2-b56f-4326-9875-fa3a1ee8953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:24.010405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e6bd2-b56f-4326-9875-fa3a1ee8953c admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:24.010739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e6bd2-b56f-4326-9875-fa3a1ee8953c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:24.011022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e6bd2-b56f-4326-9875-fa3a1ee8953c admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:24.011792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e6bd2-b56f-4326-9875-fa3a1ee8953c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:24.014402 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e6bd2-b56f-4326-9875-fa3a1ee8953c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:24.045798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1232/2455] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:23 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:24.049825 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc3cac-a9d7-4be6-9ea9-da7772393c05 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:24.062884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc3cac-a9d7-4be6-9ea9-da7772393c05 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:24.157598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dfd66-a432-4c9b-a358-8cf3e32c777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:24.158303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dfd66-a432-4c9b-a358-8cf3e32c777d admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:24.158592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dfd66-a432-4c9b-a358-8cf3e32c777d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:24.159131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dfd66-a432-4c9b-a358-8cf3e32c777d admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:24.159620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dfd66-a432-4c9b-a358-8cf3e32c777d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:24.161529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dfd66-a432-4c9b-a358-8cf3e32c777d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:24.186591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1224/2456] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:24 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:24.192710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e6bd2-b56f-4326-9875-fa3a1ee8953c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:24.207494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e6bd2-b56f-4326-9875-fa3a1ee8953c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:24.212625 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919d034-9b9c-40c6-9938-117489e00e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:24.222780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919d034-9b9c-40c6-9938-117489e00e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:24.223164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919d034-9b9c-40c6-9938-117489e00e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:24.223517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919d034-9b9c-40c6-9938-117489e00e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:24.224719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919d034-9b9c-40c6-9938-117489e00e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:24.226321 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919d034-9b9c-40c6-9938-117489e00e71 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:24.240211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1233/2457] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:24.254262 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dfd66-a432-4c9b-a358-8cf3e32c777d admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:24.271649 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dfd66-a432-4c9b-a358-8cf3e32c777d admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:24.276649 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90a4a-92a3-416e-8889-b7b234573c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:24.277813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90a4a-92a3-416e-8889-b7b234573c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:24.278110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90a4a-92a3-416e-8889-b7b234573c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:24.278388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a90a4a-92a3-416e-8889-b7b234573c0d admin admin] PATH_INFO: `/v3/projects/519387bd9538413c89bce5f6fd8b3288/users/f8675da5adf64901a4861df4c3ca4f77/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:24.305382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a90a4a-92a3-416e-8889-b7b234573c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=519387bd9538413c89bce5f6fd8b3288, user_id=f8675da5adf64901a4861df4c3ca4f77, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:24.308289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a90a4a-92a3-416e-8889-b7b234573c0d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:24.325323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1225/2458] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:24 2022] PUT /identity/v3/projects/519387bd9538413c89bce5f6fd8b3288/users/f8675da5adf64901a4861df4c3ca4f77/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:24.330053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919d034-9b9c-40c6-9938-117489e00e71 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:24.340484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919d034-9b9c-40c6-9938-117489e00e71 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:24.407472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76db5d-4793-472f-bfa8-acafdf4fbb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:24.408197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76db5d-4793-472f-bfa8-acafdf4fbb72 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:24.408489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76db5d-4793-472f-bfa8-acafdf4fbb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:24.408774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76db5d-4793-472f-bfa8-acafdf4fbb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:24.409555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76db5d-4793-472f-bfa8-acafdf4fbb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:24.411180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76db5d-4793-472f-bfa8-acafdf4fbb72 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:24.423330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1234/2459] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:24.427868 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90a4a-92a3-416e-8889-b7b234573c0d admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:24.439396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a90a4a-92a3-416e-8889-b7b234573c0d admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:24.444623 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17e499-c369-4e35-8b92-cc8503d70fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:24.445521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e499-c369-4e35-8b92-cc8503d70fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:24.445896 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e499-c369-4e35-8b92-cc8503d70fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:24.446182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17e499-c369-4e35-8b92-cc8503d70fe9 admin admin] PATH_INFO: `/v3/projects/519387bd9538413c89bce5f6fd8b3288/users/f8675da5adf64901a4861df4c3ca4f77/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:24.448311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17e499-c369-4e35-8b92-cc8503d70fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519387bd9538413c89bce5f6fd8b3288, user_id=f8675da5adf64901a4861df4c3ca4f77, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:24.451141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17e499-c369-4e35-8b92-cc8503d70fe9 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:24.462023 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1226/2460] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:24 2022] PUT /identity/v3/projects/519387bd9538413c89bce5f6fd8b3288/users/f8675da5adf64901a4861df4c3ca4f77/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:24.473293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34065d-08b5-42e0-b0c7-46bb7335adea None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:24.473479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34065d-08b5-42e0-b0c7-46bb7335adea None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:24.473895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34065d-08b5-42e0-b0c7-46bb7335adea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:24.501211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-0f34065d-08b5-42e0-b0c7-46bb7335adea None None] MFA Rules not processed for user `f8675da5adf64901a4861df4c3ca4f77`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:24.502406 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-0f34065d-08b5-42e0-b0c7-46bb7335adea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:24.507328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:24.569598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1235/2461] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:24.583281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17e499-c369-4e35-8b92-cc8503d70fe9 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:24.584998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5d17e499-c369-4e35-8b92-cc8503d70fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:24.625140 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:24.644252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17e499-c369-4e35-8b92-cc8503d70fe9 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:24.647861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0df5bd-90a1-4342-805b-37cab62c2978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:24.648536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0df5bd-90a1-4342-805b-37cab62c2978 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:24.648823 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0df5bd-90a1-4342-805b-37cab62c2978 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:24.649101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0df5bd-90a1-4342-805b-37cab62c2978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:24.704432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0df5bd-90a1-4342-805b-37cab62c2978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:24.705882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0df5bd-90a1-4342-805b-37cab62c2978 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:24.714680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1227/2462] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:24.992290 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34065d-08b5-42e0-b0c7-46bb7335adea None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:24.994090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-0f34065d-08b5-42e0-b0c7-46bb7335adea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:25.058415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34065d-08b5-42e0-b0c7-46bb7335adea None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:25.062631 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc430643-7b7c-49cb-91ef-d42301bd30c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:25.063274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc430643-7b7c-49cb-91ef-d42301bd30c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:25.063556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc430643-7b7c-49cb-91ef-d42301bd30c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:25.063856 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc430643-7b7c-49cb-91ef-d42301bd30c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:25.065750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-cc430643-7b7c-49cb-91ef-d42301bd30c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:25.076744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc430643-7b7c-49cb-91ef-d42301bd30c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:25.078170 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc430643-7b7c-49cb-91ef-d42301bd30c3 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:25.086164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1236/2463] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:26.202345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0df5bd-90a1-4342-805b-37cab62c2978 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:26.210822 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0df5bd-90a1-4342-805b-37cab62c2978 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:26.214529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d930d82-fd01-4407-a041-c19b4efed8ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:26.215711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930d82-fd01-4407-a041-c19b4efed8ce service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:26.216019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930d82-fd01-4407-a041-c19b4efed8ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:26.216298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930d82-fd01-4407-a041-c19b4efed8ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:26.271354 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d930d82-fd01-4407-a041-c19b4efed8ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:26.272725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d930d82-fd01-4407-a041-c19b4efed8ce service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:26.281407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1228/2464] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:26.659015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc430643-7b7c-49cb-91ef-d42301bd30c3 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:26.669479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc430643-7b7c-49cb-91ef-d42301bd30c3 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:26.673582 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1178e-17ac-474f-baa7-5b7fa9e70a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:26.674242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1178e-17ac-474f-baa7-5b7fa9e70a16 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:26.674531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1178e-17ac-474f-baa7-5b7fa9e70a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:26.674815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1178e-17ac-474f-baa7-5b7fa9e70a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:26.676627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e4b1178e-17ac-474f-baa7-5b7fa9e70a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:26.743259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1178e-17ac-474f-baa7-5b7fa9e70a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:26.744853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1178e-17ac-474f-baa7-5b7fa9e70a16 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:26.755648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1237/2465] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:26.814662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d930d82-fd01-4407-a041-c19b4efed8ce service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:26.823577 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d930d82-fd01-4407-a041-c19b4efed8ce service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:26.827332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968da57c-d52f-43aa-8591-8010860200f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:26.828157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da57c-d52f-43aa-8591-8010860200f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:26.828510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da57c-d52f-43aa-8591-8010860200f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:26.828795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da57c-d52f-43aa-8591-8010860200f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:26.837849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968da57c-d52f-43aa-8591-8010860200f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:26.839288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968da57c-d52f-43aa-8591-8010860200f7 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:26.849060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1229/2466] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:29.382789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1178e-17ac-474f-baa7-5b7fa9e70a16 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:29.384431 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e4b1178e-17ac-474f-baa7-5b7fa9e70a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:29.397620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1178e-17ac-474f-baa7-5b7fa9e70a16 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:29.403404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803ebdc-d711-4bd3-9724-f89a786696ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:29.405071 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803ebdc-d711-4bd3-9724-f89a786696ea service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:29.410587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803ebdc-d711-4bd3-9724-f89a786696ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:29.411129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803ebdc-d711-4bd3-9724-f89a786696ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:29.413661 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f803ebdc-d711-4bd3-9724-f89a786696ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:29.424154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803ebdc-d711-4bd3-9724-f89a786696ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:29.425991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803ebdc-d711-4bd3-9724-f89a786696ea service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:29.438232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1238/2467] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:29.924024 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968da57c-d52f-43aa-8591-8010860200f7 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:29.925706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-968da57c-d52f-43aa-8591-8010860200f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:30.054734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968da57c-d52f-43aa-8591-8010860200f7 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:30.060543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ddb2-f5e2-46fc-95b1-c0ce3626ef5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dde39c6d85446a681dea24573f0d6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:30.061213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ddb2-f5e2-46fc-95b1-c0ce3626ef5d service placement] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:30.061849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ddb2-f5e2-46fc-95b1-c0ce3626ef5d service placement] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:30.062287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ddb2-f5e2-46fc-95b1-c0ce3626ef5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:30.064600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7915ddb2-f5e2-46fc-95b1-c0ce3626ef5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:30.081150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915ddb2-f5e2-46fc-95b1-c0ce3626ef5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:30.082902 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915ddb2-f5e2-46fc-95b1-c0ce3626ef5d service placement] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:30.101682 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1230/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:30.715065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803ebdc-d711-4bd3-9724-f89a786696ea service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:30.716600 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f803ebdc-d711-4bd3-9724-f89a786696ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:30.736238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803ebdc-d711-4bd3-9724-f89a786696ea service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:30.740882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d00c9-286e-4c8f-9361-26e0eecd5a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:30.741762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d00c9-286e-4c8f-9361-26e0eecd5a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:30.742432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d00c9-286e-4c8f-9361-26e0eecd5a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:30.742432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d00c9-286e-4c8f-9361-26e0eecd5a6f admin admin] PATH_INFO: `/v3/users/fbc6b66ed796481abf4fdea66692f4a8` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:30.743509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d00c9-286e-4c8f-9361-26e0eecd5a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc6b66ed796481abf4fdea66692f4a8)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:30.745612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d00c9-286e-4c8f-9361-26e0eecd5a6f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:30.776080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:30.804180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b29d00c9-286e-4c8f-9361-26e0eecd5a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc6b66ed796481abf4fdea66692f4a8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:30.804845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b29d00c9-286e-4c8f-9361-26e0eecd5a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc6b66ed796481abf4fdea66692f4a8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:30.812100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ddb2-f5e2-46fc-95b1-c0ce3626ef5d service placement] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:30.818435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:30.819800 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b29d00c9-286e-4c8f-9361-26e0eecd5a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc6b66ed796481abf4fdea66692f4a8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:30.820578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b29d00c9-286e-4c8f-9361-26e0eecd5a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc6b66ed796481abf4fdea66692f4a8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:30.823702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ddb2-f5e2-46fc-95b1-c0ce3626ef5d service placement] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:30.828422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-b29d00c9-286e-4c8f-9361-26e0eecd5a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc6b66ed796481abf4fdea66692f4a8'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:30.835644 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:30.836733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:30.837016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:30.837296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] PATH_INFO: `/v3/users/1a1a1027fdf149a9826ad8602b190676` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:30.838486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a1a1027fdf149a9826ad8602b190676)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:30.840959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:30.842044 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1239/2469] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:30 2022] DELETE /identity/v3/users/fbc6b66ed796481abf4fdea66692f4a8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:30.898227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1a1027fdf149a9826ad8602b190676'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:30.913914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1a1027fdf149a9826ad8602b190676'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:30.915103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1a1027fdf149a9826ad8602b190676'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:30.925545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1a1027fdf149a9826ad8602b190676'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:30.933085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1a1027fdf149a9826ad8602b190676'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:30.942787 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1231/2470] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:30 2022] DELETE /identity/v3/users/1a1a1027fdf149a9826ad8602b190676 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:30.945261 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801e0df-1440-4ffc-86f8-caff18d638a6 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:30.945555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801e0df-1440-4ffc-86f8-caff18d638a6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:30.945837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801e0df-1440-4ffc-86f8-caff18d638a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:30.969715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6801e0df-1440-4ffc-86f8-caff18d638a6 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:30.971921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6801e0df-1440-4ffc-86f8-caff18d638a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:31.052897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1240/2471] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:31.063154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:31.064803 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:31.108072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801e0df-1440-4ffc-86f8-caff18d638a6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:31.109616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6801e0df-1440-4ffc-86f8-caff18d638a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:31.122955 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801e0df-1440-4ffc-86f8-caff18d638a6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:31.128238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:31.129112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.129409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.129693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] PATH_INFO: `/v3/projects/df590b79c53a4e74b47e8b821b8a3ea3` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.130955 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df590b79c53a4e74b47e8b821b8a3ea3)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:31.132968 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:31.144211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc201f-d48a-4bec-b620-a270dbb3d5b5 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:31.149539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7bea-09ec-4245-8179-2a0fa47897ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:31.150363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7bea-09ec-4245-8179-2a0fa47897ed service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.150701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7bea-09ec-4245-8179-2a0fa47897ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.151005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7bea-09ec-4245-8179-2a0fa47897ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.173423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b7bea-09ec-4245-8179-2a0fa47897ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:31.174963 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b7bea-09ec-4245-8179-2a0fa47897ed service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:31.186758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1232/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:31.199641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df590b79c53a4e74b47e8b821b8a3ea3', 'request_id': 'req-03bed55f-04a4-43a8-999f-2cb88d842a14'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.208962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df590b79c53a4e74b47e8b821b8a3ea3', 'request_id': 'req-03bed55f-04a4-43a8-999f-2cb88d842a14'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.215887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df590b79c53a4e74b47e8b821b8a3ea3', 'request_id': 'req-03bed55f-04a4-43a8-999f-2cb88d842a14'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.228859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] The token cache is being invalidate because project df590b79c53a4e74b47e8b821b8a3ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:31.229121 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.229750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-03bed55f-04a4-43a8-999f-2cb88d842a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.231897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1241/2473] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:31 2022] DELETE /identity/v3/projects/df590b79c53a4e74b47e8b821b8a3ea3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:31.237006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438658-1b6c-4e6f-b60e-628f8a0c3e6c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.237305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438658-1b6c-4e6f-b60e-628f8a0c3e6c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.237611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa438658-1b6c-4e6f-b60e-628f8a0c3e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.262345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-fa438658-1b6c-4e6f-b60e-628f8a0c3e6c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:31.263678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-fa438658-1b6c-4e6f-b60e-628f8a0c3e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:31.332060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1233/2474] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:31.339440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f0390-527d-4b5a-80eb-a30f134c0f15 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.339735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f0390-527d-4b5a-80eb-a30f134c0f15 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.340152 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f0390-527d-4b5a-80eb-a30f134c0f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.359038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-3c4f0390-527d-4b5a-80eb-a30f134c0f15 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:31.360319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-3c4f0390-527d-4b5a-80eb-a30f134c0f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:31.372557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1242/2475] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:31.374121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa438658-1b6c-4e6f-b60e-628f8a0c3e6c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:31.394150 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa438658-1b6c-4e6f-b60e-628f8a0c3e6c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:31.399807 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34279ed6-f06e-45aa-aab4-eb4b7e13008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:31.400594 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34279ed6-f06e-45aa-aab4-eb4b7e13008b admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.400970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34279ed6-f06e-45aa-aab4-eb4b7e13008b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.401310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34279ed6-f06e-45aa-aab4-eb4b7e13008b admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.402705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34279ed6-f06e-45aa-aab4-eb4b7e13008b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:30:31.403097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34279ed6-f06e-45aa-aab4-eb4b7e13008b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:31.405208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34279ed6-f06e-45aa-aab4-eb4b7e13008b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:31.420640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1234/2476] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:30:31.426688 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f0390-527d-4b5a-80eb-a30f134c0f15 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:31.438080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f0390-527d-4b5a-80eb-a30f134c0f15 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:31.443308 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363e986-bf46-4745-b798-2725f688a677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:31.444279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363e986-bf46-4745-b798-2725f688a677 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.444563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363e986-bf46-4745-b798-2725f688a677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.444835 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363e986-bf46-4745-b798-2725f688a677 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.445544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363e986-bf46-4745-b798-2725f688a677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:31.447451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363e986-bf46-4745-b798-2725f688a677 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:31.461929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:31.488047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1243/2477] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:31 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:30:31.491385 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34279ed6-f06e-45aa-aab4-eb4b7e13008b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:31.510863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34279ed6-f06e-45aa-aab4-eb4b7e13008b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:31.520220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:31.554906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363e986-bf46-4745-b798-2725f688a677 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:31.557502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b363e986-bf46-4745-b798-2725f688a677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:31.629824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd6523-bc25-4176-862f-df833e26fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:31.630794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd6523-bc25-4176-862f-df833e26fc73 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.631247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd6523-bc25-4176-862f-df833e26fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.631910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd6523-bc25-4176-862f-df833e26fc73 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.632926 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd6523-bc25-4176-862f-df833e26fc73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:31.635052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd6523-bc25-4176-862f-df833e26fc73 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:31.651422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363e986-bf46-4745-b798-2725f688a677 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:31.660928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1235/2478] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:31 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:31.661112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:31.661112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.661112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.661112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] PATH_INFO: `/v3/projects/c2642988ee614f88bd15e29044a3e954` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.662215 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd6523-bc25-4176-862f-df833e26fc73 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:31.662383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2642988ee614f88bd15e29044a3e954)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:31.664446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:31.675154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd6523-bc25-4176-862f-df833e26fc73 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:31.680142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24ec4-cd81-4d3d-b08e-7660bfc26c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:31.680810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24ec4-cd81-4d3d-b08e-7660bfc26c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.681098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24ec4-cd81-4d3d-b08e-7660bfc26c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.681378 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24ec4-cd81-4d3d-b08e-7660bfc26c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.682101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc24ec4-cd81-4d3d-b08e-7660bfc26c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:31.683784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc24ec4-cd81-4d3d-b08e-7660bfc26c40 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:31.697876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1236/2479] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:31.703191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24ec4-cd81-4d3d-b08e-7660bfc26c40 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:31.719636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24ec4-cd81-4d3d-b08e-7660bfc26c40 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:31.719805 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2642988ee614f88bd15e29044a3e954', 'request_id': 'req-fb66845d-19b3-4391-bb58-78d9cec02c33'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.727514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2642988ee614f88bd15e29044a3e954', 'request_id': 'req-fb66845d-19b3-4391-bb58-78d9cec02c33'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.734997 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2642988ee614f88bd15e29044a3e954', 'request_id': 'req-fb66845d-19b3-4391-bb58-78d9cec02c33'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.751895 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] The token cache is being invalidate because project c2642988ee614f88bd15e29044a3e954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:31.752332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.753263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.755621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1244/2480] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:31 2022] DELETE /identity/v3/projects/c2642988ee614f88bd15e29044a3e954 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:31.759892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:31.761908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:31.799107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940c6c-7143-43ef-bc8d-a39b0fffbb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:31.799774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940c6c-7143-43ef-bc8d-a39b0fffbb5e admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.800093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940c6c-7143-43ef-bc8d-a39b0fffbb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.800374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940c6c-7143-43ef-bc8d-a39b0fffbb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.801105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940c6c-7143-43ef-bc8d-a39b0fffbb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:31.802688 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940c6c-7143-43ef-bc8d-a39b0fffbb5e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:31.812573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1237/2481] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:30:31.816448 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940c6c-7143-43ef-bc8d-a39b0fffbb5e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:31.818120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6e940c6c-7143-43ef-bc8d-a39b0fffbb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:31.830968 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66845d-19b3-4391-bb58-78d9cec02c33 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:31.831179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940c6c-7143-43ef-bc8d-a39b0fffbb5e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:31.835496 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf141c-910b-4ad4-b0a5-682c87ff6a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:31.835681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3b6bf-de32-4177-b474-85889310fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:31.836400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf141c-910b-4ad4-b0a5-682c87ff6a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.836587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b6bf-de32-4177-b474-85889310fc8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.836685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf141c-910b-4ad4-b0a5-682c87ff6a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.836874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b6bf-de32-4177-b474-85889310fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.836983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf141c-910b-4ad4-b0a5-682c87ff6a9d admin admin] PATH_INFO: `/v3/users/da2a3c25b1b14340bb6447d95959cee7` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.837156 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b6bf-de32-4177-b474-85889310fc8f admin admin] PATH_INFO: `/v3/projects/3aac2781cc5b4abab9509b7c897a25b1/users/05ea0bd2123d4edf8576657b2580c82f/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.838129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf141c-910b-4ad4-b0a5-682c87ff6a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2a3c25b1b14340bb6447d95959cee7)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:31.840717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf141c-910b-4ad4-b0a5-682c87ff6a9d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:31.852862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3b6bf-de32-4177-b474-85889310fc8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aac2781cc5b4abab9509b7c897a25b1, user_id=05ea0bd2123d4edf8576657b2580c82f, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:31.855530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3b6bf-de32-4177-b474-85889310fc8f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:31.869060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:31.869806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1238/2482] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:31 2022] PUT /identity/v3/projects/3aac2781cc5b4abab9509b7c897a25b1/users/05ea0bd2123d4edf8576657b2580c82f/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:31.879874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c6dd-0f8f-477e-ad4d-e1e781b620c8 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.880253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c6dd-0f8f-477e-ad4d-e1e781b620c8 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.880585 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c6dd-0f8f-477e-ad4d-e1e781b620c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.906092 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2dcf141c-910b-4ad4-b0a5-682c87ff6a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2a3c25b1b14340bb6447d95959cee7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.906964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2dcf141c-910b-4ad4-b0a5-682c87ff6a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2a3c25b1b14340bb6447d95959cee7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.911025 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7a54c6dd-0f8f-477e-ad4d-e1e781b620c8 None None] MFA Rules not processed for user `05ea0bd2123d4edf8576657b2580c82f`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:31.912298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7a54c6dd-0f8f-477e-ad4d-e1e781b620c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:31.919998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2dcf141c-910b-4ad4-b0a5-682c87ff6a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2a3c25b1b14340bb6447d95959cee7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.921140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2dcf141c-910b-4ad4-b0a5-682c87ff6a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2a3c25b1b14340bb6447d95959cee7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.933381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2dcf141c-910b-4ad4-b0a5-682c87ff6a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2a3c25b1b14340bb6447d95959cee7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:31.948355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1245/2483] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:31 2022] DELETE /identity/v3/users/da2a3c25b1b14340bb6447d95959cee7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:31.961150 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d384e-91fe-4755-a51b-2cedee528089 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:31.961447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d384e-91fe-4755-a51b-2cedee528089 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:31.961735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d384e-91fe-4755-a51b-2cedee528089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:31.965646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:31.980241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-1f9d384e-91fe-4755-a51b-2cedee528089 None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:31.981782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1f9d384e-91fe-4755-a51b-2cedee528089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:31.989227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1239/2484] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:31.993369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54c6dd-0f8f-477e-ad4d-e1e781b620c8 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:31.994944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7a54c6dd-0f8f-477e-ad4d-e1e781b620c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:32.056761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1246/2485] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:30:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:32.073610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d384e-91fe-4755-a51b-2cedee528089 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:32.075141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1f9d384e-91fe-4755-a51b-2cedee528089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:32.085136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54c6dd-0f8f-477e-ad4d-e1e781b620c8 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:32.153458 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed96f0-9e4e-4403-a71f-c855f835c813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:32.154552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed96f0-9e4e-4403-a71f-c855f835c813 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:32.154552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed96f0-9e4e-4403-a71f-c855f835c813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:32.154726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed96f0-9e4e-4403-a71f-c855f835c813 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:32.155369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed96f0-9e4e-4403-a71f-c855f835c813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:32.157383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed96f0-9e4e-4403-a71f-c855f835c813 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:32.180429 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d384e-91fe-4755-a51b-2cedee528089 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:32.188593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5824b62-8f90-4d15-b18c-9e4010ea4ca8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:32.189943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5824b62-8f90-4d15-b18c-9e4010ea4ca8 service swift] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:32.190297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5824b62-8f90-4d15-b18c-9e4010ea4ca8 service swift] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:32.190772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5824b62-8f90-4d15-b18c-9e4010ea4ca8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:32.192607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1240/2486] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:31 2022] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:30:32.205231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed96f0-9e4e-4403-a71f-c855f835c813 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:32.206815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5824b62-8f90-4d15-b18c-9e4010ea4ca8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:32.218604 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5824b62-8f90-4d15-b18c-9e4010ea4ca8 service swift] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:32.231088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1247/2487] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:30:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:30:32.305900 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed96f0-9e4e-4403-a71f-c855f835c813 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:32.328664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad185-9314-4a69-bf71-38f386815b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:32.329380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad185-9314-4a69-bf71-38f386815b21 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:32.329647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad185-9314-4a69-bf71-38f386815b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:32.329932 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fad185-9314-4a69-bf71-38f386815b21 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:32.330791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fad185-9314-4a69-bf71-38f386815b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:32.333121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fad185-9314-4a69-bf71-38f386815b21 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:32.348759 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5824b62-8f90-4d15-b18c-9e4010ea4ca8 service swift] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:32.350442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d5824b62-8f90-4d15-b18c-9e4010ea4ca8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:32.368331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1241/2488] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:32 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:32.369197 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad185-9314-4a69-bf71-38f386815b21 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:32.381164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5824b62-8f90-4d15-b18c-9e4010ea4ca8 service swift] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:32.389962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:32.391687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:32.392304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fad185-9314-4a69-bf71-38f386815b21 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:32.392664 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:32.393345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] PATH_INFO: `/v3/projects/0d6bd9d0e56342f2ab5082beff045742` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:32.395695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6bd9d0e56342f2ab5082beff045742)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:32.398951 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:32.400840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e63299-b9eb-4fcf-bcf7-c1cf4e5e9740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:32.402089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e63299-b9eb-4fcf-bcf7-c1cf4e5e9740 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:32.402806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e63299-b9eb-4fcf-bcf7-c1cf4e5e9740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:32.403186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e63299-b9eb-4fcf-bcf7-c1cf4e5e9740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:32.405307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e63299-b9eb-4fcf-bcf7-c1cf4e5e9740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:32.408626 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e63299-b9eb-4fcf-bcf7-c1cf4e5e9740 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:32.413582 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:32.439342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1242/2489] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:32.442631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e63299-b9eb-4fcf-bcf7-c1cf4e5e9740 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:32.453379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:32.454874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e63299-b9eb-4fcf-bcf7-c1cf4e5e9740 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:32.473626 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6bd9d0e56342f2ab5082beff045742', 'request_id': 'req-9f6df965-4dd1-454e-a19d-6b3219dcefb1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:32.487622 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6bd9d0e56342f2ab5082beff045742', 'request_id': 'req-9f6df965-4dd1-454e-a19d-6b3219dcefb1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:32.504442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6bd9d0e56342f2ab5082beff045742', 'request_id': 'req-9f6df965-4dd1-454e-a19d-6b3219dcefb1'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:32.529708 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] The token cache is being invalidate because project 0d6bd9d0e56342f2ab5082beff045742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:32.529924 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:32.531914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:32.540518 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1248/2490] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:32 2022] DELETE /identity/v3/projects/0d6bd9d0e56342f2ab5082beff045742 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:32.541431 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:32.543009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:32.574220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1f4ac-cf1a-48fa-9cd0-6561e1a2d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:32.576264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1f4ac-cf1a-48fa-9cd0-6561e1a2d7df admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:32.576765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1f4ac-cf1a-48fa-9cd0-6561e1a2d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:32.577113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1f4ac-cf1a-48fa-9cd0-6561e1a2d7df admin admin] PATH_INFO: `/v3/projects/d2a62af16cab4070b60dff12cbd3dfe6/users/011fe8b35afc4a029c1f1e3a42a8daac/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:32.611821 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1f4ac-cf1a-48fa-9cd0-6561e1a2d7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a62af16cab4070b60dff12cbd3dfe6, user_id=011fe8b35afc4a029c1f1e3a42a8daac, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:32.623036 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1f4ac-cf1a-48fa-9cd0-6561e1a2d7df admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:32.659408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1243/2491] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:32 2022] PUT /identity/v3/projects/d2a62af16cab4070b60dff12cbd3dfe6/users/011fe8b35afc4a029c1f1e3a42a8daac/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:32.661133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1f4ac-cf1a-48fa-9cd0-6561e1a2d7df admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:32.664098 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-dab1f4ac-cf1a-48fa-9cd0-6561e1a2d7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:32.689618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6df965-4dd1-454e-a19d-6b3219dcefb1 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:32.772858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:32.773756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:32.774038 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:32.774320 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] PATH_INFO: `/v3/users/f8675da5adf64901a4861df4c3ca4f77` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:32.775558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8675da5adf64901a4861df4c3ca4f77)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:32.778112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:32.780281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1f4ac-cf1a-48fa-9cd0-6561e1a2d7df admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:32.788283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77152e05-c4e3-4f29-9b56-f15ba193ace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:32.789648 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77152e05-c4e3-4f29-9b56-f15ba193ace4 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:32.790156 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77152e05-c4e3-4f29-9b56-f15ba193ace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:32.790578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77152e05-c4e3-4f29-9b56-f15ba193ace4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:32.792229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77152e05-c4e3-4f29-9b56-f15ba193ace4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:32.795252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77152e05-c4e3-4f29-9b56-f15ba193ace4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:32.816428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1244/2492] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:32.825380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77152e05-c4e3-4f29-9b56-f15ba193ace4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:32.841173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77152e05-c4e3-4f29-9b56-f15ba193ace4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:32.852919 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c48783-a5af-4930-a96d-5fbd89937f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:32.854262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8675da5adf64901a4861df4c3ca4f77'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:32.855567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8675da5adf64901a4861df4c3ca4f77'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:32.856199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c48783-a5af-4930-a96d-5fbd89937f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:32.856516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c48783-a5af-4930-a96d-5fbd89937f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:32.858191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c48783-a5af-4930-a96d-5fbd89937f05 admin admin] PATH_INFO: `/v3/projects/d2a62af16cab4070b60dff12cbd3dfe6/users/011fe8b35afc4a029c1f1e3a42a8daac/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:32.865662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c48783-a5af-4930-a96d-5fbd89937f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a62af16cab4070b60dff12cbd3dfe6, user_id=011fe8b35afc4a029c1f1e3a42a8daac, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:32.874196 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c48783-a5af-4930-a96d-5fbd89937f05 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:32.884471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8675da5adf64901a4861df4c3ca4f77'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:32.886412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8675da5adf64901a4861df4c3ca4f77'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:32.896578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:32.904412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8675da5adf64901a4861df4c3ca4f77'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:32.923495 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1245/2493] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:32 2022] PUT /identity/v3/projects/d2a62af16cab4070b60dff12cbd3dfe6/users/011fe8b35afc4a029c1f1e3a42a8daac/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:32.926451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99000a-ba94-4a65-a6fa-367e1363444a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:32.926964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99000a-ba94-4a65-a6fa-367e1363444a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:32.927442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99000a-ba94-4a65-a6fa-367e1363444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:32.932190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1249/2494] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:32 2022] DELETE /identity/v3/users/f8675da5adf64901a4861df4c3ca4f77 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:32.985710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-3b99000a-ba94-4a65-a6fa-367e1363444a None None] MFA Rules not processed for user `011fe8b35afc4a029c1f1e3a42a8daac`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:32.987842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3b99000a-ba94-4a65-a6fa-367e1363444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:33.073053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:33.106378 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1246/2495] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:33.120048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:33.122036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:33.222467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e2c06-e571-4a6c-bfc4-cb18c795f06e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:33.231262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5e4f-19d0-4a94-8216-21a9edd5290f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:33.231952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e4f-19d0-4a94-8216-21a9edd5290f service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:33.233064 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e4f-19d0-4a94-8216-21a9edd5290f service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:33.233064 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f5e4f-19d0-4a94-8216-21a9edd5290f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:33.255838 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f5e4f-19d0-4a94-8216-21a9edd5290f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:33.257321 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f5e4f-19d0-4a94-8216-21a9edd5290f service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:33.289517 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1250/2496] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:33.360770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99000a-ba94-4a65-a6fa-367e1363444a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:33.363173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3b99000a-ba94-4a65-a6fa-367e1363444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:33.415284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5e4f-19d0-4a94-8216-21a9edd5290f service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:33.425729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f5e4f-19d0-4a94-8216-21a9edd5290f service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:33.435463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3a34f-b86c-4c84-886a-ec251ac8d254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:33.436418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a34f-b86c-4c84-886a-ec251ac8d254 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:33.436725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a34f-b86c-4c84-886a-ec251ac8d254 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:33.436998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a34f-b86c-4c84-886a-ec251ac8d254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:33.444374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-01a3a34f-b86c-4c84-886a-ec251ac8d254 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:33.473768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99000a-ba94-4a65-a6fa-367e1363444a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:33.479407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:33.481253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:33.481757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:33.482400 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] PATH_INFO: `/v3/projects/519387bd9538413c89bce5f6fd8b3288` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:33.483993 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=519387bd9538413c89bce5f6fd8b3288)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:33.486142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:33.558068 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519387bd9538413c89bce5f6fd8b3288', 'request_id': 'req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:33.568246 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519387bd9538413c89bce5f6fd8b3288', 'request_id': 'req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:33.578404 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519387bd9538413c89bce5f6fd8b3288', 'request_id': 'req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:33.583172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3a34f-b86c-4c84-886a-ec251ac8d254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:33.584814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3a34f-b86c-4c84-886a-ec251ac8d254 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:33.592969 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] The token cache is being invalidate because project 519387bd9538413c89bce5f6fd8b3288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:33.593535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:33.594636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-e41ae4f1-d746-4c7b-ba2e-366f68b700e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:33.599950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1247/2497] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:33 2022] DELETE /identity/v3/projects/519387bd9538413c89bce5f6fd8b3288 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:33.602672 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455789-b1c8-4224-8ef2-f443b246b2ea None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:33.602968 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455789-b1c8-4224-8ef2-f443b246b2ea None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:33.603318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13455789-b1c8-4224-8ef2-f443b246b2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:33.615465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1251/2498] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:30:33.625263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-13455789-b1c8-4224-8ef2-f443b246b2ea None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:33.626486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-13455789-b1c8-4224-8ef2-f443b246b2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:33.706670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1248/2499] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:33.715720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2ec79-d9f6-4320-8468-906cda1418c1 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:33.716048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2ec79-d9f6-4320-8468-906cda1418c1 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:33.716468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2ec79-d9f6-4320-8468-906cda1418c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:33.742573 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ece2ec79-d9f6-4320-8468-906cda1418c1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:33.743799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ece2ec79-d9f6-4320-8468-906cda1418c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:33.775294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1252/2500] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:33.779910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455789-b1c8-4224-8ef2-f443b246b2ea None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:33.791941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13455789-b1c8-4224-8ef2-f443b246b2ea None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:33.798485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31027ed4-0913-4d09-87ab-3f742415dab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:33.799168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027ed4-0913-4d09-87ab-3f742415dab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:33.799464 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027ed4-0913-4d09-87ab-3f742415dab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:33.799725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027ed4-0913-4d09-87ab-3f742415dab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:33.800497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31027ed4-0913-4d09-87ab-3f742415dab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:30:33.800807 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31027ed4-0913-4d09-87ab-3f742415dab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:33.802417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31027ed4-0913-4d09-87ab-3f742415dab5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:33.815908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1249/2501] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:30:33.820967 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2ec79-d9f6-4320-8468-906cda1418c1 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:33.847825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2ec79-d9f6-4320-8468-906cda1418c1 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:33.858060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3699a6-68ff-4697-808a-d2e6f446a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:33.858876 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3699a6-68ff-4697-808a-d2e6f446a70f admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:33.859166 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3699a6-68ff-4697-808a-d2e6f446a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:33.859449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3699a6-68ff-4697-808a-d2e6f446a70f admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:33.860188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3699a6-68ff-4697-808a-d2e6f446a70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:33.865959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3699a6-68ff-4697-808a-d2e6f446a70f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:33.913327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1253/2502] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:33 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:33.917837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31027ed4-0913-4d09-87ab-3f742415dab5 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:33.933216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31027ed4-0913-4d09-87ab-3f742415dab5 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:33.939218 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:34.010983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b557e9-ff74-497e-b35d-3c8b9484a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:34.011784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b557e9-ff74-497e-b35d-3c8b9484a7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:34.012105 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b557e9-ff74-497e-b35d-3c8b9484a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:34.012395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b557e9-ff74-497e-b35d-3c8b9484a7a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:34.013114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b557e9-ff74-497e-b35d-3c8b9484a7a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:34.015345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b557e9-ff74-497e-b35d-3c8b9484a7a0 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:34.065694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1250/2503] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:33 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:30:34.070230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3699a6-68ff-4697-808a-d2e6f446a70f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:34.088180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3699a6-68ff-4697-808a-d2e6f446a70f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:34.094203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115159f6-5649-4f74-9229-889ae2f9403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:34.095330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115159f6-5649-4f74-9229-889ae2f9403a admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:34.095908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115159f6-5649-4f74-9229-889ae2f9403a admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:34.096887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115159f6-5649-4f74-9229-889ae2f9403a admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:34.097853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115159f6-5649-4f74-9229-889ae2f9403a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:34.100003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115159f6-5649-4f74-9229-889ae2f9403a admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:34.114962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1254/2504] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:34.119805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b557e9-ff74-497e-b35d-3c8b9484a7a0 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:34.135920 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b557e9-ff74-497e-b35d-3c8b9484a7a0 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:34.142269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70334e2d-b78f-44a4-a62e-e1b6493d8570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:34.144011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334e2d-b78f-44a4-a62e-e1b6493d8570 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:34.144011 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334e2d-b78f-44a4-a62e-e1b6493d8570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:34.144237 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70334e2d-b78f-44a4-a62e-e1b6493d8570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:34.145190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70334e2d-b78f-44a4-a62e-e1b6493d8570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:34.146877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70334e2d-b78f-44a4-a62e-e1b6493d8570 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:34.160001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1251/2505] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:34.163045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115159f6-5649-4f74-9229-889ae2f9403a admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:34.173886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115159f6-5649-4f74-9229-889ae2f9403a admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:34.180104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229d18d-3180-4b6e-b9bd-83fb27595431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:34.181337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229d18d-3180-4b6e-b9bd-83fb27595431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:34.181844 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229d18d-3180-4b6e-b9bd-83fb27595431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:34.182357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229d18d-3180-4b6e-b9bd-83fb27595431 admin admin] PATH_INFO: `/v3/projects/863997a26d7b421da9a3e2f1a2e9a9a7/users/1ca080e39a194d9797b789ac85f272e3/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:34.216000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229d18d-3180-4b6e-b9bd-83fb27595431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863997a26d7b421da9a3e2f1a2e9a9a7, user_id=1ca080e39a194d9797b789ac85f272e3, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:34.219353 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229d18d-3180-4b6e-b9bd-83fb27595431 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:34.237748 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1255/2506] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:34 2022] PUT /identity/v3/projects/863997a26d7b421da9a3e2f1a2e9a9a7/users/1ca080e39a194d9797b789ac85f272e3/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:34.253995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651186-9675-4a48-8caa-b503a679a668 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:34.254619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651186-9675-4a48-8caa-b503a679a668 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:34.255084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651186-9675-4a48-8caa-b503a679a668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:34.285991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0f651186-9675-4a48-8caa-b503a679a668 None None] MFA Rules not processed for user `1ca080e39a194d9797b789ac85f272e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:34.287641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0f651186-9675-4a48-8caa-b503a679a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:34.380049 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1252/2507] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:34.391120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229d18d-3180-4b6e-b9bd-83fb27595431 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:34.392827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e229d18d-3180-4b6e-b9bd-83fb27595431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:34.426310 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:34.493415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229d18d-3180-4b6e-b9bd-83fb27595431 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:34.497562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed72529-748d-4457-9f6e-be81cec98d34 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee61aece9c64e74806248e4ac49cd47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:34.498312 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72529-748d-4457-9f6e-be81cec98d34 service glance] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:34.498668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72529-748d-4457-9f6e-be81cec98d34 service glance] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:34.499044 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72529-748d-4457-9f6e-be81cec98d34 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:34.508113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed72529-748d-4457-9f6e-be81cec98d34 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:34.509669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed72529-748d-4457-9f6e-be81cec98d34 service glance] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:34.519554 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1256/2508] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:40.203060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651186-9675-4a48-8caa-b503a679a668 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:40.204522 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0f651186-9675-4a48-8caa-b503a679a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:40.282173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651186-9675-4a48-8caa-b503a679a668 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:40.286889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:40.287770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:40.288094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:40.288377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] PATH_INFO: `/v3/users/05ea0bd2123d4edf8576657b2580c82f` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:40.289568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ea0bd2123d4edf8576657b2580c82f)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:40.291525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:40.308722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:40.360250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ea0bd2123d4edf8576657b2580c82f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:40.387532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ea0bd2123d4edf8576657b2580c82f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:40.388305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ea0bd2123d4edf8576657b2580c82f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:40.398014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ea0bd2123d4edf8576657b2580c82f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:40.406392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ea0bd2123d4edf8576657b2580c82f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:40.415257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1253/2509] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:40 2022] DELETE /identity/v3/users/05ea0bd2123d4edf8576657b2580c82f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:40.420031 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa194-2db7-4617-a142-3d2dbb36d697 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:40.420559 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa194-2db7-4617-a142-3d2dbb36d697 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:40.420559 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa194-2db7-4617-a142-3d2dbb36d697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:40.440940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ea9fa194-2db7-4617-a142-3d2dbb36d697 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:40.442551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ea9fa194-2db7-4617-a142-3d2dbb36d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:40.517589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1257/2510] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:40.520873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:40.522293 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:40.579029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c5093-f3f0-46a5-9299-2a61a041b82c admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:40.582725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca3846-3754-47e3-8257-9fe3221a4386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:40.583368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3846-3754-47e3-8257-9fe3221a4386 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:40.583678 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3846-3754-47e3-8257-9fe3221a4386 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:40.583955 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca3846-3754-47e3-8257-9fe3221a4386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:40.593138 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca3846-3754-47e3-8257-9fe3221a4386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:40.594566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca3846-3754-47e3-8257-9fe3221a4386 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:40.603870 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1254/2511] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:40.928745 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fa194-2db7-4617-a142-3d2dbb36d697 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:40.930196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ea9fa194-2db7-4617-a142-3d2dbb36d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:40.952083 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fa194-2db7-4617-a142-3d2dbb36d697 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:40.957615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:40.958469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:40.958757 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:40.959045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] PATH_INFO: `/v3/projects/3aac2781cc5b4abab9509b7c897a25b1` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:40.960586 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aac2781cc5b4abab9509b7c897a25b1)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:40.962492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:41.008206 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aac2781cc5b4abab9509b7c897a25b1', 'request_id': 'req-587904d5-669c-4494-9f4c-854e20c50875'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.015599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aac2781cc5b4abab9509b7c897a25b1', 'request_id': 'req-587904d5-669c-4494-9f4c-854e20c50875'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.021795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aac2781cc5b4abab9509b7c897a25b1', 'request_id': 'req-587904d5-669c-4494-9f4c-854e20c50875'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.033462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] The token cache is being invalidate because project 3aac2781cc5b4abab9509b7c897a25b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:41.033957 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.034672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.039348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1258/2512] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:40 2022] DELETE /identity/v3/projects/3aac2781cc5b4abab9509b7c897a25b1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:41.046548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca3846-3754-47e3-8257-9fe3221a4386 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:41.056841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca3846-3754-47e3-8257-9fe3221a4386 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:41.112954 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de578acd-4e75-429a-b2ec-bdb7bd007b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:41.113827 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de578acd-4e75-429a-b2ec-bdb7bd007b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:41.114116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de578acd-4e75-429a-b2ec-bdb7bd007b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:41.114397 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de578acd-4e75-429a-b2ec-bdb7bd007b67 admin admin] PATH_INFO: `/v3/users/011fe8b35afc4a029c1f1e3a42a8daac` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:41.115595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de578acd-4e75-429a-b2ec-bdb7bd007b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=011fe8b35afc4a029c1f1e3a42a8daac)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:41.117557 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de578acd-4e75-429a-b2ec-bdb7bd007b67 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:41.159095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:41.166416 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-de578acd-4e75-429a-b2ec-bdb7bd007b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '011fe8b35afc4a029c1f1e3a42a8daac'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.179527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-de578acd-4e75-429a-b2ec-bdb7bd007b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '011fe8b35afc4a029c1f1e3a42a8daac'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.179527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-de578acd-4e75-429a-b2ec-bdb7bd007b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '011fe8b35afc4a029c1f1e3a42a8daac'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.188444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-de578acd-4e75-429a-b2ec-bdb7bd007b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '011fe8b35afc4a029c1f1e3a42a8daac'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.195846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-de578acd-4e75-429a-b2ec-bdb7bd007b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '011fe8b35afc4a029c1f1e3a42a8daac'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.202110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1255/2513] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:41 2022] DELETE /identity/v3/users/011fe8b35afc4a029c1f1e3a42a8daac => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:41.489461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:41.490952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:41.511742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587904d5-669c-4494-9f4c-854e20c50875 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:41.545765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:41.577382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:41.578388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:41.578727 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:41.579035 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] PATH_INFO: `/v3/projects/d2a62af16cab4070b60dff12cbd3dfe6` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:41.580416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a62af16cab4070b60dff12cbd3dfe6)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:41.582374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:41.631858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a62af16cab4070b60dff12cbd3dfe6', 'request_id': 'req-d0c5a615-71f9-468f-a64a-e34747637700'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.640018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a62af16cab4070b60dff12cbd3dfe6', 'request_id': 'req-d0c5a615-71f9-468f-a64a-e34747637700'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.645930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a62af16cab4070b60dff12cbd3dfe6', 'request_id': 'req-d0c5a615-71f9-468f-a64a-e34747637700'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.657708 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] The token cache is being invalidate because project d2a62af16cab4070b60dff12cbd3dfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:41.658002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.658637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d0c5a615-71f9-468f-a64a-e34747637700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:41.660243 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1259/2514] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:41 2022] DELETE /identity/v3/projects/d2a62af16cab4070b60dff12cbd3dfe6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:30:41.665457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c3cc-5bab-4484-9437-7d18bfb4b9ac None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:41.666008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c3cc-5bab-4484-9437-7d18bfb4b9ac None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:41.666008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9c3cc-5bab-4484-9437-7d18bfb4b9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:41.687520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-a3d9c3cc-5bab-4484-9437-7d18bfb4b9ac None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:41.687520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a3d9c3cc-5bab-4484-9437-7d18bfb4b9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:41.751892 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1256/2515] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:41.759450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3ebd5-d8b0-442e-a8d5-c4d399e7a5dc None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:41.759744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3ebd5-d8b0-442e-a8d5-c4d399e7a5dc None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:41.760079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3ebd5-d8b0-442e-a8d5-c4d399e7a5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:41.781640 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-46e3ebd5-d8b0-442e-a8d5-c4d399e7a5dc None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:41.782873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-46e3ebd5-d8b0-442e-a8d5-c4d399e7a5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:41.790819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1260/2516] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:41.795039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9c3cc-5bab-4484-9437-7d18bfb4b9ac None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:41.804805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9c3cc-5bab-4484-9437-7d18bfb4b9ac None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:41.809525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea5278-3911-4075-80cd-2082f9d32c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:41.810506 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea5278-3911-4075-80cd-2082f9d32c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:41.810938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea5278-3911-4075-80cd-2082f9d32c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:41.811390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea5278-3911-4075-80cd-2082f9d32c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:41.812583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea5278-3911-4075-80cd-2082f9d32c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:30:41.813061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea5278-3911-4075-80cd-2082f9d32c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:41.815610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea5278-3911-4075-80cd-2082f9d32c4a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:41.831029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1257/2517] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:30:41.835466 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3ebd5-d8b0-442e-a8d5-c4d399e7a5dc None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:41.845380 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3ebd5-d8b0-442e-a8d5-c4d399e7a5dc None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:41.850094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be8469-c580-48cb-a22f-784598736ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:41.850763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be8469-c580-48cb-a22f-784598736ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:41.851051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be8469-c580-48cb-a22f-784598736ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:41.851335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be8469-c580-48cb-a22f-784598736ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:41.852090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be8469-c580-48cb-a22f-784598736ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:41.854040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be8469-c580-48cb-a22f-784598736ec2 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:41.879758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1261/2518] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:41 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:41.883707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea5278-3911-4075-80cd-2082f9d32c4a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:41.894482 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea5278-3911-4075-80cd-2082f9d32c4a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:41.965930 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb592f2-82ac-4885-bb05-ad13b69900e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:41.967402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb592f2-82ac-4885-bb05-ad13b69900e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:41.967402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb592f2-82ac-4885-bb05-ad13b69900e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:41.967402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb592f2-82ac-4885-bb05-ad13b69900e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:41.968432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb592f2-82ac-4885-bb05-ad13b69900e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:41.970442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb592f2-82ac-4885-bb05-ad13b69900e4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:41.991503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1258/2519] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:41 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:41.996296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be8469-c580-48cb-a22f-784598736ec2 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:42.007419 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be8469-c580-48cb-a22f-784598736ec2 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:42.013943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a86bc-6304-4b1c-8c78-c999ca248943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:42.016005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a86bc-6304-4b1c-8c78-c999ca248943 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.016005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a86bc-6304-4b1c-8c78-c999ca248943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.016005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a86bc-6304-4b1c-8c78-c999ca248943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.016497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a86bc-6304-4b1c-8c78-c999ca248943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:42.023630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a86bc-6304-4b1c-8c78-c999ca248943 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:42.039987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1262/2520] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:30:42.044262 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb592f2-82ac-4885-bb05-ad13b69900e4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:42.055201 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb592f2-82ac-4885-bb05-ad13b69900e4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:42.059837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfaa6b-7207-4d06-8ea1-08e14b80ff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:42.060576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfaa6b-7207-4d06-8ea1-08e14b80ff13 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.060869 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfaa6b-7207-4d06-8ea1-08e14b80ff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.061154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfaa6b-7207-4d06-8ea1-08e14b80ff13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.061913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfaa6b-7207-4d06-8ea1-08e14b80ff13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:42.063634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbfaa6b-7207-4d06-8ea1-08e14b80ff13 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:42.074216 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1259/2521] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:42.078687 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a86bc-6304-4b1c-8c78-c999ca248943 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:42.089970 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a86bc-6304-4b1c-8c78-c999ca248943 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:42.094892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd953ee-117b-4beb-b520-54d6bd78cd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:42.096033 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd953ee-117b-4beb-b520-54d6bd78cd34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.096324 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd953ee-117b-4beb-b520-54d6bd78cd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.096604 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd953ee-117b-4beb-b520-54d6bd78cd34 admin admin] PATH_INFO: `/v3/projects/33fdefa2560b4f33a9e4e411d72aa13c/users/25e6d4119f7245c59efe64927961a593/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.112393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd953ee-117b-4beb-b520-54d6bd78cd34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fdefa2560b4f33a9e4e411d72aa13c, user_id=25e6d4119f7245c59efe64927961a593, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:42.115065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd953ee-117b-4beb-b520-54d6bd78cd34 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:42.132044 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1263/2522] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:42 2022] PUT /identity/v3/projects/33fdefa2560b4f33a9e4e411d72aa13c/users/25e6d4119f7245c59efe64927961a593/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:42.143412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930269b5-1747-4d8a-ac9c-425c4887f2cf None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.143710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930269b5-1747-4d8a-ac9c-425c4887f2cf None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.144020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930269b5-1747-4d8a-ac9c-425c4887f2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.170962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-930269b5-1747-4d8a-ac9c-425c4887f2cf None None] MFA Rules not processed for user `25e6d4119f7245c59efe64927961a593`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:42.172203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-930269b5-1747-4d8a-ac9c-425c4887f2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:42.181414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:42.242884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1260/2523] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:42.247799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd953ee-117b-4beb-b520-54d6bd78cd34 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:42.314257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:42.320462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd953ee-117b-4beb-b520-54d6bd78cd34 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:42.326725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b8ccc-419e-4ad4-960d-76e486b4505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:42.327477 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b8ccc-419e-4ad4-960d-76e486b4505a admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.327826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b8ccc-419e-4ad4-960d-76e486b4505a admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.328206 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b8ccc-419e-4ad4-960d-76e486b4505a admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.328985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b8ccc-419e-4ad4-960d-76e486b4505a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:42.330885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b8ccc-419e-4ad4-960d-76e486b4505a admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:42.356230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1264/2524] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:42 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:42.360362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930269b5-1747-4d8a-ac9c-425c4887f2cf None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:42.371902 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930269b5-1747-4d8a-ac9c-425c4887f2cf None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:42.430883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571942a3-7bbf-41ad-9b89-8d3381c6913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:42.431564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571942a3-7bbf-41ad-9b89-8d3381c6913d admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.431849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571942a3-7bbf-41ad-9b89-8d3381c6913d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.432159 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571942a3-7bbf-41ad-9b89-8d3381c6913d admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.432846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571942a3-7bbf-41ad-9b89-8d3381c6913d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:42.435419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571942a3-7bbf-41ad-9b89-8d3381c6913d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:42.461424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1261/2525] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:42 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:42.463001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b8ccc-419e-4ad4-960d-76e486b4505a admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:42.474762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b8ccc-419e-4ad4-960d-76e486b4505a admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:42.479635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68be47e-0181-495e-aad5-e290854387cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:42.481049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68be47e-0181-495e-aad5-e290854387cd admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.481201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68be47e-0181-495e-aad5-e290854387cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.481466 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68be47e-0181-495e-aad5-e290854387cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.482230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68be47e-0181-495e-aad5-e290854387cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:42.483823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68be47e-0181-495e-aad5-e290854387cd admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:42.504603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1265/2526] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:42.506441 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571942a3-7bbf-41ad-9b89-8d3381c6913d admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:42.517637 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571942a3-7bbf-41ad-9b89-8d3381c6913d admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:42.522290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3005-31a6-44fd-8c8a-5410ab21f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:42.523163 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3005-31a6-44fd-8c8a-5410ab21f9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.523497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3005-31a6-44fd-8c8a-5410ab21f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.523757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3005-31a6-44fd-8c8a-5410ab21f9d0 admin admin] PATH_INFO: `/v3/projects/d7c2e7d2291f4512b4b146e2e2ff7a39/users/52f2fe7c74604b09b3a3db021e7c34ba/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.537992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f3005-31a6-44fd-8c8a-5410ab21f9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c2e7d2291f4512b4b146e2e2ff7a39, user_id=52f2fe7c74604b09b3a3db021e7c34ba, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:42.540815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f3005-31a6-44fd-8c8a-5410ab21f9d0 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:42.554535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1262/2527] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:42 2022] PUT /identity/v3/projects/d7c2e7d2291f4512b4b146e2e2ff7a39/users/52f2fe7c74604b09b3a3db021e7c34ba/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:42.558772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68be47e-0181-495e-aad5-e290854387cd admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:42.568883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68be47e-0181-495e-aad5-e290854387cd admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:42.625297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1e296-eb25-4fab-9902-ebc67c11ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:42.625965 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e296-eb25-4fab-9902-ebc67c11ffeb admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.626250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e296-eb25-4fab-9902-ebc67c11ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.626528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e296-eb25-4fab-9902-ebc67c11ffeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.627242 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1e296-eb25-4fab-9902-ebc67c11ffeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:42.628853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1e296-eb25-4fab-9902-ebc67c11ffeb admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:42.638928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1266/2528] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:42.643084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3005-31a6-44fd-8c8a-5410ab21f9d0 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:42.653250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3005-31a6-44fd-8c8a-5410ab21f9d0 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:42.658155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ea740-4b52-4c83-945d-d932f668695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:42.658965 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ea740-4b52-4c83-945d-d932f668695b admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.659252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ea740-4b52-4c83-945d-d932f668695b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.659560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ea740-4b52-4c83-945d-d932f668695b admin admin] PATH_INFO: `/v3/projects/d7c2e7d2291f4512b4b146e2e2ff7a39/users/52f2fe7c74604b09b3a3db021e7c34ba/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.661712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ea740-4b52-4c83-945d-d932f668695b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c2e7d2291f4512b4b146e2e2ff7a39, user_id=52f2fe7c74604b09b3a3db021e7c34ba, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:42.664633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ea740-4b52-4c83-945d-d932f668695b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:42.676947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1263/2529] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:42 2022] PUT /identity/v3/projects/d7c2e7d2291f4512b4b146e2e2ff7a39/users/52f2fe7c74604b09b3a3db021e7c34ba/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:42.687444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19973-ecc0-4be7-a5a5-f1889a5551ed None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.687741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19973-ecc0-4be7-a5a5-f1889a5551ed None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.688058 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19973-ecc0-4be7-a5a5-f1889a5551ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.714029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-30f19973-ecc0-4be7-a5a5-f1889a5551ed None None] MFA Rules not processed for user `52f2fe7c74604b09b3a3db021e7c34ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:42.715803 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-30f19973-ecc0-4be7-a5a5-f1889a5551ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:42.789823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1267/2530] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:42.800492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ea740-4b52-4c83-945d-d932f668695b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:42.802162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b12ea740-4b52-4c83-945d-d932f668695b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:42.870611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ea740-4b52-4c83-945d-d932f668695b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:42.874449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bf168-c7d6-4ca7-814c-30d8cdf006bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:42.875095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bf168-c7d6-4ca7-814c-30d8cdf006bd service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:42.875377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bf168-c7d6-4ca7-814c-30d8cdf006bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:42.875652 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bf168-c7d6-4ca7-814c-30d8cdf006bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:42.892104 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:42.932363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bf168-c7d6-4ca7-814c-30d8cdf006bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:42.933826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bf168-c7d6-4ca7-814c-30d8cdf006bd service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:42.943989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1264/2531] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:45.330050 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b8c34-c15a-46f4-931c-f1e406e1c75d None None] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:45.330621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b8c34-c15a-46f4-931c-f1e406e1c75d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:45.330722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b8c34-c15a-46f4-931c-f1e406e1c75d None None] PATH_INFO: `/` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:45.332279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1268/2532] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:30:45.338247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa917f14-bda9-445f-9405-e258e707c991 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:45.338718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa917f14-bda9-445f-9405-e258e707c991 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:45.338939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa917f14-bda9-445f-9405-e258e707c991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:45.357211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-fa917f14-bda9-445f-9405-e258e707c991 None None] MFA Rules not processed for user `9c142f4d77b54982abcd4b76edbcb4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:45.358558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-fa917f14-bda9-445f-9405-e258e707c991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:45.421291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1265/2533] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:30:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:45.433863 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b8c34-c15a-46f4-931c-f1e406e1c75d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:45.435570 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-962b8c34-c15a-46f4-931c-f1e406e1c75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:45.449024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b8c34-c15a-46f4-931c-f1e406e1c75d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:45.459107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de5359-f327-4d6a-8498-74eb9c3326be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:45.459779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de5359-f327-4d6a-8498-74eb9c3326be service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:45.460101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de5359-f327-4d6a-8498-74eb9c3326be service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:45.460382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de5359-f327-4d6a-8498-74eb9c3326be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:45.468720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de5359-f327-4d6a-8498-74eb9c3326be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:45.470198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de5359-f327-4d6a-8498-74eb9c3326be service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:45.483108 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1269/2534] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:30:45.574242 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012333b0-d81b-4ae9-8975-1a720cb5f308 None None] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:45.574877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012333b0-d81b-4ae9-8975-1a720cb5f308 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:45.575344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012333b0-d81b-4ae9-8975-1a720cb5f308 None None] PATH_INFO: `/` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:45.577388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1266/2535] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 16 00:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:30:45.583478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007846-91e8-49c5-afc4-dde5b46e9523 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:45.583772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007846-91e8-49c5-afc4-dde5b46e9523 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:45.584088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007846-91e8-49c5-afc4-dde5b46e9523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:45.596436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012333b0-d81b-4ae9-8975-1a720cb5f308 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:45.598139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-012333b0-d81b-4ae9-8975-1a720cb5f308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:45.610292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-69007846-91e8-49c5-afc4-dde5b46e9523 None None] MFA Rules not processed for user `cd57046b084b463488296b825097081d`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:45.611506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-69007846-91e8-49c5-afc4-dde5b46e9523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:45.612739 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012333b0-d81b-4ae9-8975-1a720cb5f308 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:45.617653 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb96e2-de70-4d57-8b33-f49f563c20ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:45.618330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb96e2-de70-4d57-8b33-f49f563c20ed service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:45.618759 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb96e2-de70-4d57-8b33-f49f563c20ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:45.619052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb96e2-de70-4d57-8b33-f49f563c20ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:45.634277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb96e2-de70-4d57-8b33-f49f563c20ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:45.635866 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb96e2-de70-4d57-8b33-f49f563c20ed service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:45.660173 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1267/2536] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:30:45.668344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:45.705880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1270/2537] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 16 00:30:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:45.717330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb96e2-de70-4d57-8b33-f49f563c20ed service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:45.726542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb96e2-de70-4d57-8b33-f49f563c20ed service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:45.739790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ed241-e586-40f9-98b3-53237baeb0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:45.741557 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed241-e586-40f9-98b3-53237baeb0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:45.741964 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed241-e586-40f9-98b3-53237baeb0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:45.742274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ed241-e586-40f9-98b3-53237baeb0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:45.753881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed241-e586-40f9-98b3-53237baeb0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:45.755314 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ed241-e586-40f9-98b3-53237baeb0b7 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:45.766529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1268/2538] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:46.413333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69007846-91e8-49c5-afc4-dde5b46e9523 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:46.414883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-69007846-91e8-49c5-afc4-dde5b46e9523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:46.429963 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69007846-91e8-49c5-afc4-dde5b46e9523 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:46.436753 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc311f0-c611-43a4-bdb7-3aa0699e7ea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:46.437468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc311f0-c611-43a4-bdb7-3aa0699e7ea4 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:46.437758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc311f0-c611-43a4-bdb7-3aa0699e7ea4 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:46.438094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc311f0-c611-43a4-bdb7-3aa0699e7ea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:46.440070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bfc311f0-c611-43a4-bdb7-3aa0699e7ea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:46.457563 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc311f0-c611-43a4-bdb7-3aa0699e7ea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:46.459270 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc311f0-c611-43a4-bdb7-3aa0699e7ea4 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:46.472078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1271/2539] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:48.089223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ee9b-3587-47f1-a2f5-3f680d30628e None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:48.089703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ee9b-3587-47f1-a2f5-3f680d30628e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:48.089882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ee9b-3587-47f1-a2f5-3f680d30628e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:48.107456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-5565ee9b-3587-47f1-a2f5-3f680d30628e None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:48.108758 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5565ee9b-3587-47f1-a2f5-3f680d30628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:48.163084 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1269/2540] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 16 00:30:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:48.175355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc311f0-c611-43a4-bdb7-3aa0699e7ea4 service nova] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:48.176820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bfc311f0-c611-43a4-bdb7-3aa0699e7ea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:48.246534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc311f0-c611-43a4-bdb7-3aa0699e7ea4 service nova] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:48.252701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815b68-a9a7-4c32-bca7-deb155cf9204 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:48.252701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815b68-a9a7-4c32-bca7-deb155cf9204 service swift] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:48.252701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815b68-a9a7-4c32-bca7-deb155cf9204 service swift] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:48.252701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815b68-a9a7-4c32-bca7-deb155cf9204 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:48.261000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815b68-a9a7-4c32-bca7-deb155cf9204 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:48.263165 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815b68-a9a7-4c32-bca7-deb155cf9204 service swift] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:48.271378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1272/2541] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:30:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:30:49.677241 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565ee9b-3587-47f1-a2f5-3f680d30628e None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:49.690580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565ee9b-3587-47f1-a2f5-3f680d30628e None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:49.697123 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c5285-5c3c-4330-91d8-725df4385981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:49.697726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c5285-5c3c-4330-91d8-725df4385981 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:49.698029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c5285-5c3c-4330-91d8-725df4385981 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:49.698310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c5285-5c3c-4330-91d8-725df4385981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:49.700182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c24c5285-5c3c-4330-91d8-725df4385981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:49.746952 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:49.760829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c5285-5c3c-4330-91d8-725df4385981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:49.762496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c5285-5c3c-4330-91d8-725df4385981 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:49.772162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1270/2542] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:57.194224 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815b68-a9a7-4c32-bca7-deb155cf9204 service swift] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:57.209846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815b68-a9a7-4c32-bca7-deb155cf9204 service swift] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:57.216224 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731d59f-9393-4a89-afef-6ec3899c529a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:57.216911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731d59f-9393-4a89-afef-6ec3899c529a service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:57.217424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731d59f-9393-4a89-afef-6ec3899c529a service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:57.217766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731d59f-9393-4a89-afef-6ec3899c529a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:57.219654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4731d59f-9393-4a89-afef-6ec3899c529a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:57.248684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731d59f-9393-4a89-afef-6ec3899c529a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:57.252467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731d59f-9393-4a89-afef-6ec3899c529a service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:57.270351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1273/2543] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:58.159569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c5285-5c3c-4330-91d8-725df4385981 service nova] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:58.223808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c5285-5c3c-4330-91d8-725df4385981 service nova] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:58.228497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:58.229413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:58.229698 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:58.230160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] PATH_INFO: `/v3/users/25e6d4119f7245c59efe64927961a593` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:58.232199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e6d4119f7245c59efe64927961a593)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:58.235182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:58.284194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e6d4119f7245c59efe64927961a593'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.295981 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e6d4119f7245c59efe64927961a593'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.296658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e6d4119f7245c59efe64927961a593'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.303820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e6d4119f7245c59efe64927961a593'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.310731 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e6d4119f7245c59efe64927961a593'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.316554 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1271/2544] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:58 2022] DELETE /identity/v3/users/25e6d4119f7245c59efe64927961a593 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:58.321230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d9f98-4e73-4ae3-baa1-1c112b226909 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:58.321711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d9f98-4e73-4ae3-baa1-1c112b226909 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:58.321818 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d9f98-4e73-4ae3-baa1-1c112b226909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:58.338663 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-de0d9f98-4e73-4ae3-baa1-1c112b226909 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:58.340487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-de0d9f98-4e73-4ae3-baa1-1c112b226909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:58.404302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1274/2545] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:58.414007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:58.417029 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:58.439914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d9f98-4e73-4ae3-baa1-1c112b226909 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:58.441381 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-de0d9f98-4e73-4ae3-baa1-1c112b226909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:58.454585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d9f98-4e73-4ae3-baa1-1c112b226909 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:58.459710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:58.460564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:58.461720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:58.461720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] PATH_INFO: `/v3/users/1ca080e39a194d9797b789ac85f272e3` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:58.462676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca080e39a194d9797b789ac85f272e3)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:58.464837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:58.488458 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4ec9-a299-4642-b211-2c33545b64dc admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:58.493470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19f1e0-4ef0-48ce-9430-6a4abdb02077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:58.494162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f1e0-4ef0-48ce-9430-6a4abdb02077 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:58.494486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f1e0-4ef0-48ce-9430-6a4abdb02077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:58.494721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19f1e0-4ef0-48ce-9430-6a4abdb02077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:58.506785 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:58.508290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19f1e0-4ef0-48ce-9430-6a4abdb02077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:58.509883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19f1e0-4ef0-48ce-9430-6a4abdb02077 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:58.521944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1272/2546] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:58.530733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca080e39a194d9797b789ac85f272e3'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.531691 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca080e39a194d9797b789ac85f272e3'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.545473 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca080e39a194d9797b789ac85f272e3'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.546219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca080e39a194d9797b789ac85f272e3'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.554452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca080e39a194d9797b789ac85f272e3'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.568861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1275/2547] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:58 2022] DELETE /identity/v3/users/1ca080e39a194d9797b789ac85f272e3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:58.574254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60108b55-2046-4b72-bf66-db1924b9d567 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:58.574651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60108b55-2046-4b72-bf66-db1924b9d567 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:58.575043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60108b55-2046-4b72-bf66-db1924b9d567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:58.587258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:58.593597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-60108b55-2046-4b72-bf66-db1924b9d567 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:58.595690 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-60108b55-2046-4b72-bf66-db1924b9d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:58.669538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1273/2548] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:58.683116 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:58.685068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:58.750101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede809d-1e4b-4cff-82c0-8a75382b1183 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:58.753866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01518d90-7d49-446a-9f66-9ca92c1b8fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:58.754518 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01518d90-7d49-446a-9f66-9ca92c1b8fad service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:58.754806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01518d90-7d49-446a-9f66-9ca92c1b8fad service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:58.755085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01518d90-7d49-446a-9f66-9ca92c1b8fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:58.765332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01518d90-7d49-446a-9f66-9ca92c1b8fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:58.766794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01518d90-7d49-446a-9f66-9ca92c1b8fad service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:58.776968 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1276/2549] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:58.814323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60108b55-2046-4b72-bf66-db1924b9d567 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:58.816223 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-60108b55-2046-4b72-bf66-db1924b9d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:58.830346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60108b55-2046-4b72-bf66-db1924b9d567 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:58.835770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:58.836800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:58.837198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:58.837518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] PATH_INFO: `/v3/projects/33fdefa2560b4f33a9e4e411d72aa13c` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:58.838976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fdefa2560b4f33a9e4e411d72aa13c)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:58.841170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:58.914670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fdefa2560b4f33a9e4e411d72aa13c', 'request_id': 'req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.923622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fdefa2560b4f33a9e4e411d72aa13c', 'request_id': 'req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.930730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fdefa2560b4f33a9e4e411d72aa13c', 'request_id': 'req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.943591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] The token cache is being invalidate because project 33fdefa2560b4f33a9e4e411d72aa13c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:58.944026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.944751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:58.948008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1274/2550] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:58 2022] DELETE /identity/v3/projects/33fdefa2560b4f33a9e4e411d72aa13c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:58.950777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01518d90-7d49-446a-9f66-9ca92c1b8fad service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:58.972171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01518d90-7d49-446a-9f66-9ca92c1b8fad service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.037112 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3be23-bf43-4160-ace6-794ba6e8c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.038134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3be23-bf43-4160-ace6-794ba6e8c1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.038609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3be23-bf43-4160-ace6-794ba6e8c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.038797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3be23-bf43-4160-ace6-794ba6e8c1ad admin admin] PATH_INFO: `/v3/users/52f2fe7c74604b09b3a3db021e7c34ba` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.040146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3be23-bf43-4160-ace6-794ba6e8c1ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f2fe7c74604b09b3a3db021e7c34ba)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:59.042669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3be23-bf43-4160-ace6-794ba6e8c1ad admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:59.091692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-33c3be23-bf43-4160-ace6-794ba6e8c1ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f2fe7c74604b09b3a3db021e7c34ba'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.092401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-33c3be23-bf43-4160-ace6-794ba6e8c1ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f2fe7c74604b09b3a3db021e7c34ba'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.097378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:59.110700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-33c3be23-bf43-4160-ace6-794ba6e8c1ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f2fe7c74604b09b3a3db021e7c34ba'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.111944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-33c3be23-bf43-4160-ace6-794ba6e8c1ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f2fe7c74604b09b3a3db021e7c34ba'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.120243 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-33c3be23-bf43-4160-ace6-794ba6e8c1ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f2fe7c74604b09b3a3db021e7c34ba'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.133972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1277/2551] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:58 2022] DELETE /identity/v3/users/52f2fe7c74604b09b3a3db021e7c34ba => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:59.186867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:59.189093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:59.203438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ccb18-62b3-4549-9668-a2cc8d8e5f5a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.292421 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.293455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.293745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.294042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] PATH_INFO: `/v3/projects/863997a26d7b421da9a3e2f1a2e9a9a7` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.295925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863997a26d7b421da9a3e2f1a2e9a9a7)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:59.298350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:59.346256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:59.363353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863997a26d7b421da9a3e2f1a2e9a9a7', 'request_id': 'req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.373362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863997a26d7b421da9a3e2f1a2e9a9a7', 'request_id': 'req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.381307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863997a26d7b421da9a3e2f1a2e9a9a7', 'request_id': 'req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.394763 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] The token cache is being invalidate because project 863997a26d7b421da9a3e2f1a2e9a9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:59.395137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.395806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.400650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1275/2552] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:59 2022] DELETE /identity/v3/projects/863997a26d7b421da9a3e2f1a2e9a9a7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:59.402782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f036cfe-5c0d-4193-a58e-4d90616d6d31 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.403937 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f036cfe-5c0d-4193-a58e-4d90616d6d31 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.404263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f036cfe-5c0d-4193-a58e-4d90616d6d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.423896 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-1f036cfe-5c0d-4193-a58e-4d90616d6d31 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:59.425544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1f036cfe-5c0d-4193-a58e-4d90616d6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:59.458023 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:59.460079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:59.511842 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1278/2553] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:59.515887 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31510-9a86-4e69-9e3d-ac34c22a1ab2 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.516749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31510-9a86-4e69-9e3d-ac34c22a1ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.517143 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31510-9a86-4e69-9e3d-ac34c22a1ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.535791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-9fe31510-9a86-4e69-9e3d-ac34c22a1ab2 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:59.537241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9fe31510-9a86-4e69-9e3d-ac34c22a1ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:59.541117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddae72-0bad-4f34-9ef0-c34a6ca175f6 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.546051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1279/2554] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:59.553544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe31510-9a86-4e69-9e3d-ac34c22a1ab2 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:59.553760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.554666 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.554983 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.555484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] PATH_INFO: `/v3/projects/d7c2e7d2291f4512b4b146e2e2ff7a39` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.556759 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c2e7d2291f4512b4b146e2e2ff7a39)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:59.559224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:59.565334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe31510-9a86-4e69-9e3d-ac34c22a1ab2 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.572239 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d77cc3-b66a-48e0-80d8-cea7bcdbe537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.574062 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d77cc3-b66a-48e0-80d8-cea7bcdbe537 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.574636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d77cc3-b66a-48e0-80d8-cea7bcdbe537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.575110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d77cc3-b66a-48e0-80d8-cea7bcdbe537 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.576159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d77cc3-b66a-48e0-80d8-cea7bcdbe537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:30:59.576451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d77cc3-b66a-48e0-80d8-cea7bcdbe537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:59.578445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d77cc3-b66a-48e0-80d8-cea7bcdbe537 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:59.602593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1280/2555] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:30:59.603462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d77cc3-b66a-48e0-80d8-cea7bcdbe537 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:59.614111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d77cc3-b66a-48e0-80d8-cea7bcdbe537 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.632501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c2e7d2291f4512b4b146e2e2ff7a39', 'request_id': 'req-8487a995-9e38-49ee-9cbb-e73b20676e04'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.641376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c2e7d2291f4512b4b146e2e2ff7a39', 'request_id': 'req-8487a995-9e38-49ee-9cbb-e73b20676e04'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.647542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c2e7d2291f4512b4b146e2e2ff7a39', 'request_id': 'req-8487a995-9e38-49ee-9cbb-e73b20676e04'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.659450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] The token cache is being invalidate because project d7c2e7d2291f4512b4b146e2e2ff7a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:59.659743 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.660498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8487a995-9e38-49ee-9cbb-e73b20676e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:59.665806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1276/2556] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:59 2022] DELETE /identity/v3/projects/d7c2e7d2291f4512b4b146e2e2ff7a39 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:59.668665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996b782-b345-4439-8dc0-d1b4cb9cd4e7 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.669095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996b782-b345-4439-8dc0-d1b4cb9cd4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.669388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996b782-b345-4439-8dc0-d1b4cb9cd4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.689867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0996b782-b345-4439-8dc0-d1b4cb9cd4e7 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:59.690002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b420025-dd55-4a13-bcfb-1e38dcb2082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.690814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b420025-dd55-4a13-bcfb-1e38dcb2082d admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.691099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b420025-dd55-4a13-bcfb-1e38dcb2082d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.691217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0996b782-b345-4439-8dc0-d1b4cb9cd4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:59.691568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b420025-dd55-4a13-bcfb-1e38dcb2082d admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.692311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b420025-dd55-4a13-bcfb-1e38dcb2082d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:59.694718 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b420025-dd55-4a13-bcfb-1e38dcb2082d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:59.700187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1277/2557] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:59.707550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397386ff-960e-4f7c-b30f-5f236b58d77d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.707918 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397386ff-960e-4f7c-b30f-5f236b58d77d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.708302 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397386ff-960e-4f7c-b30f-5f236b58d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.723489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1281/2558] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:59 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:59.727848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b420025-dd55-4a13-bcfb-1e38dcb2082d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:59.728175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-397386ff-960e-4f7c-b30f-5f236b58d77d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:59.729972 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-397386ff-960e-4f7c-b30f-5f236b58d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:59.730510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-9b420025-dd55-4a13-bcfb-1e38dcb2082d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:59.774488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:59.775105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:59.797717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1278/2559] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:59.801866 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397386ff-960e-4f7c-b30f-5f236b58d77d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:59.805347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b420025-dd55-4a13-bcfb-1e38dcb2082d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.810633 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be463a-c9ec-42fc-8cdf-cd891b6708e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.810814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397386ff-960e-4f7c-b30f-5f236b58d77d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.811596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be463a-c9ec-42fc-8cdf-cd891b6708e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.811993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be463a-c9ec-42fc-8cdf-cd891b6708e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.812348 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be463a-c9ec-42fc-8cdf-cd891b6708e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.813159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be463a-c9ec-42fc-8cdf-cd891b6708e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:59.815145 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be463a-c9ec-42fc-8cdf-cd891b6708e5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:59.815426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e57a4-3728-4f80-a36a-eee2dc441af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.816103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e57a4-3728-4f80-a36a-eee2dc441af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.816406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e57a4-3728-4f80-a36a-eee2dc441af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.816686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e57a4-3728-4f80-a36a-eee2dc441af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.817410 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e57a4-3728-4f80-a36a-eee2dc441af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:30:59.817720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e57a4-3728-4f80-a36a-eee2dc441af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:59.819608 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e57a4-3728-4f80-a36a-eee2dc441af4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:59.833000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1279/2560] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:30:59.837247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e57a4-3728-4f80-a36a-eee2dc441af4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:59.838427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1282/2561] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:59 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:30:59.843157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be463a-c9ec-42fc-8cdf-cd891b6708e5 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:59.848131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e57a4-3728-4f80-a36a-eee2dc441af4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.853453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1b26a-6b11-4285-a58f-2bb93422e4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.854059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b26a-6b11-4285-a58f-2bb93422e4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.854184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be463a-c9ec-42fc-8cdf-cd891b6708e5 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.854377 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b26a-6b11-4285-a58f-2bb93422e4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.854661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1b26a-6b11-4285-a58f-2bb93422e4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.855382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1b26a-6b11-4285-a58f-2bb93422e4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:59.857319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1b26a-6b11-4285-a58f-2bb93422e4c3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:59.859012 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc39bde-9ef3-441a-a3ca-d37ac6345196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.859667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc39bde-9ef3-441a-a3ca-d37ac6345196 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.859958 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc39bde-9ef3-441a-a3ca-d37ac6345196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.860288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc39bde-9ef3-441a-a3ca-d37ac6345196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.861016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc39bde-9ef3-441a-a3ca-d37ac6345196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:59.862686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc39bde-9ef3-441a-a3ca-d37ac6345196 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:59.874008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1283/2562] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:30:59.877741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc39bde-9ef3-441a-a3ca-d37ac6345196 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:59.888199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc39bde-9ef3-441a-a3ca-d37ac6345196 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.890524 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1280/2563] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:30:59 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:30:59.894510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1b26a-6b11-4285-a58f-2bb93422e4c3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:59.952262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877c990-a55f-4e09-ac51-b5fb56440add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.953180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877c990-a55f-4e09-ac51-b5fb56440add admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.953514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877c990-a55f-4e09-ac51-b5fb56440add admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.953790 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877c990-a55f-4e09-ac51-b5fb56440add admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.954543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877c990-a55f-4e09-ac51-b5fb56440add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:59.956167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877c990-a55f-4e09-ac51-b5fb56440add admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:59.964154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1b26a-6b11-4285-a58f-2bb93422e4c3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.965847 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1284/2564] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:30:59.969832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877c990-a55f-4e09-ac51-b5fb56440add admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:59.971378 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183559cd-1413-4768-b5fa-c38ad0a485de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.972080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183559cd-1413-4768-b5fa-c38ad0a485de admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.972372 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183559cd-1413-4768-b5fa-c38ad0a485de admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.972654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183559cd-1413-4768-b5fa-c38ad0a485de admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.973345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183559cd-1413-4768-b5fa-c38ad0a485de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:59.975386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183559cd-1413-4768-b5fa-c38ad0a485de admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:59.979403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877c990-a55f-4e09-ac51-b5fb56440add admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:59.984186 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10fccf-c819-4008-a4da-76d709ecba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:59.985135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10fccf-c819-4008-a4da-76d709ecba07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:59.985428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10fccf-c819-4008-a4da-76d709ecba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:59.985686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10fccf-c819-4008-a4da-76d709ecba07 admin admin] PATH_INFO: `/v3/projects/aba1ddc6cb6b4035a6d337bed861fc7f/users/891a761def1f4618b2678a62a8dd7c9c/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:59.999072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1281/2565] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:30:59 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:31:00.000200 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183559cd-1413-4768-b5fa-c38ad0a485de admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.001330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10fccf-c819-4008-a4da-76d709ecba07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba1ddc6cb6b4035a6d337bed861fc7f, user_id=891a761def1f4618b2678a62a8dd7c9c, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.004190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10fccf-c819-4008-a4da-76d709ecba07 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.010411 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183559cd-1413-4768-b5fa-c38ad0a485de admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.015479 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a2955-6bf1-472e-98cc-86d8c9995e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.016179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a2955-6bf1-472e-98cc-86d8c9995e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.016472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a2955-6bf1-472e-98cc-86d8c9995e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.016755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a2955-6bf1-472e-98cc-86d8c9995e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.018001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a2955-6bf1-472e-98cc-86d8c9995e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.018630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1285/2566] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:30:59 2022] PUT /identity/v3/projects/aba1ddc6cb6b4035a6d337bed861fc7f/users/891a761def1f4618b2678a62a8dd7c9c/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:00.019709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a2955-6bf1-472e-98cc-86d8c9995e30 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.030204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1282/2567] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:00.034399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10fccf-c819-4008-a4da-76d709ecba07 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.083315 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93bf1-cb65-4619-b660-3dc2c1383d5b None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.083606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93bf1-cb65-4619-b660-3dc2c1383d5b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.083890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93bf1-cb65-4619-b660-3dc2c1383d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.101064 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10fccf-c819-4008-a4da-76d709ecba07 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.105799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3e7e7-b768-4979-abae-16f33de6c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.106393 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3e7e7-b768-4979-abae-16f33de6c613 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.106675 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3e7e7-b768-4979-abae-16f33de6c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.106961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3e7e7-b768-4979-abae-16f33de6c613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.107685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3e7e7-b768-4979-abae-16f33de6c613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.109310 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3e7e7-b768-4979-abae-16f33de6c613 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.110277 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-30c93bf1-cb65-4619-b660-3dc2c1383d5b None None] MFA Rules not processed for user `891a761def1f4618b2678a62a8dd7c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:00.111645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-30c93bf1-cb65-4619-b660-3dc2c1383d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:00.119017 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1286/2568] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:31:00.123619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3e7e7-b768-4979-abae-16f33de6c613 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.132935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3e7e7-b768-4979-abae-16f33de6c613 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.138009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a496e8-90ca-4960-8af2-d22c9176452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.138867 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a496e8-90ca-4960-8af2-d22c9176452d admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.139153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a496e8-90ca-4960-8af2-d22c9176452d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.139428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a496e8-90ca-4960-8af2-d22c9176452d admin admin] PATH_INFO: `/v3/projects/b2bd6db173b9476c9828f43ae15c6b19/users/d9edce4197244b9287d29980ffaf18c4/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.155332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a496e8-90ca-4960-8af2-d22c9176452d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2bd6db173b9476c9828f43ae15c6b19, user_id=d9edce4197244b9287d29980ffaf18c4, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.157986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a496e8-90ca-4960-8af2-d22c9176452d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.166163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:00.171798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1287/2569] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:00 2022] PUT /identity/v3/projects/b2bd6db173b9476c9828f43ae15c6b19/users/d9edce4197244b9287d29980ffaf18c4/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:00.180174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1283/2570] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:00.185819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d08ae-abcb-443a-8c6a-6264d354b0cd None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.186129 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d08ae-abcb-443a-8c6a-6264d354b0cd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.186446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d08ae-abcb-443a-8c6a-6264d354b0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.191782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c93bf1-cb65-4619-b660-3dc2c1383d5b None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.193516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-30c93bf1-cb65-4619-b660-3dc2c1383d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:00.213356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:00.213628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-1a1d08ae-abcb-443a-8c6a-6264d354b0cd None None] MFA Rules not processed for user `d9edce4197244b9287d29980ffaf18c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:00.214966 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1a1d08ae-abcb-443a-8c6a-6264d354b0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:00.251708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c93bf1-cb65-4619-b660-3dc2c1383d5b None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.278787 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1288/2571] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:00.283132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d08ae-abcb-443a-8c6a-6264d354b0cd None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.300766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941a91b-3c9b-41b6-92a5-3d169e3872e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.301413 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941a91b-3c9b-41b6-92a5-3d169e3872e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.301696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941a91b-3c9b-41b6-92a5-3d169e3872e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.301971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941a91b-3c9b-41b6-92a5-3d169e3872e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.345746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d08ae-abcb-443a-8c6a-6264d354b0cd None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.351664 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54668f40-2e67-4de8-9978-3ec776e0ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.352366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54668f40-2e67-4de8-9978-3ec776e0ea1a admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.352702 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54668f40-2e67-4de8-9978-3ec776e0ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.352927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54668f40-2e67-4de8-9978-3ec776e0ea1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.353616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54668f40-2e67-4de8-9978-3ec776e0ea1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.356132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54668f40-2e67-4de8-9978-3ec776e0ea1a admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.361149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941a91b-3c9b-41b6-92a5-3d169e3872e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.362596 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941a91b-3c9b-41b6-92a5-3d169e3872e4 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.372437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1284/2572] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:31:00.392418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1289/2573] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:00 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:31:00.396561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941a91b-3c9b-41b6-92a5-3d169e3872e4 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.407840 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941a91b-3c9b-41b6-92a5-3d169e3872e4 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.464970 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0acbc8-acfe-44bb-bcd4-6521c54bf9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.465641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0acbc8-acfe-44bb-bcd4-6521c54bf9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.465931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0acbc8-acfe-44bb-bcd4-6521c54bf9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.466208 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0acbc8-acfe-44bb-bcd4-6521c54bf9e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.466901 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0acbc8-acfe-44bb-bcd4-6521c54bf9e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.468841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0acbc8-acfe-44bb-bcd4-6521c54bf9e4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.488092 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1285/2574] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:00 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:00.492507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54668f40-2e67-4de8-9978-3ec776e0ea1a admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.503639 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54668f40-2e67-4de8-9978-3ec776e0ea1a admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.508345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86fed4-d6e1-4979-801a-0ac7a16d08a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.509010 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86fed4-d6e1-4979-801a-0ac7a16d08a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.509302 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86fed4-d6e1-4979-801a-0ac7a16d08a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.509580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86fed4-d6e1-4979-801a-0ac7a16d08a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.510311 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86fed4-d6e1-4979-801a-0ac7a16d08a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.511987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86fed4-d6e1-4979-801a-0ac7a16d08a5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.522212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1290/2575] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:00.526328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0acbc8-acfe-44bb-bcd4-6521c54bf9e4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.536254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0acbc8-acfe-44bb-bcd4-6521c54bf9e4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.540998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75697bb7-6fff-4fca-a786-1a26bfa4edf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.542518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75697bb7-6fff-4fca-a786-1a26bfa4edf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.542518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75697bb7-6fff-4fca-a786-1a26bfa4edf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.542756 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75697bb7-6fff-4fca-a786-1a26bfa4edf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.543547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75697bb7-6fff-4fca-a786-1a26bfa4edf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.545187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75697bb7-6fff-4fca-a786-1a26bfa4edf7 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.555193 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1286/2576] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:31:00.560296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86fed4-d6e1-4979-801a-0ac7a16d08a5 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.570601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86fed4-d6e1-4979-801a-0ac7a16d08a5 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.576385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d1139-5148-47cf-8a80-76b4d6b98f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.577271 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d1139-5148-47cf-8a80-76b4d6b98f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.577566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d1139-5148-47cf-8a80-76b4d6b98f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.577855 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d1139-5148-47cf-8a80-76b4d6b98f5d admin admin] PATH_INFO: `/v3/projects/053ae92ee81e4f64a2a8ba38924cac5a/users/9c5b8baa023e40d2b79dc9f673f7eee1/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.595798 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d1139-5148-47cf-8a80-76b4d6b98f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=053ae92ee81e4f64a2a8ba38924cac5a, user_id=9c5b8baa023e40d2b79dc9f673f7eee1, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.598481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d1139-5148-47cf-8a80-76b4d6b98f5d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.612962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1291/2577] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:00 2022] PUT /identity/v3/projects/053ae92ee81e4f64a2a8ba38924cac5a/users/9c5b8baa023e40d2b79dc9f673f7eee1/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:00.622834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcad46a-7ccf-4453-ac6b-3e14061ac4c0 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.623118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcad46a-7ccf-4453-ac6b-3e14061ac4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.623399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcad46a-7ccf-4453-ac6b-3e14061ac4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.636329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:00.651402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-cbcad46a-7ccf-4453-ac6b-3e14061ac4c0 None None] MFA Rules not processed for user `9c5b8baa023e40d2b79dc9f673f7eee1`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:00.652713 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-cbcad46a-7ccf-4453-ac6b-3e14061ac4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:00.725674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1287/2578] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:00.730571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d1139-5148-47cf-8a80-76b4d6b98f5d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.767802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:00.805371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d1139-5148-47cf-8a80-76b4d6b98f5d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.810535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1716f-b6dd-4d1b-87e2-dd5e286e55e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.810833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1716f-b6dd-4d1b-87e2-dd5e286e55e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.811060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1716f-b6dd-4d1b-87e2-dd5e286e55e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.811342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1716f-b6dd-4d1b-87e2-dd5e286e55e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.812086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1716f-b6dd-4d1b-87e2-dd5e286e55e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.813991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1716f-b6dd-4d1b-87e2-dd5e286e55e9 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.848000 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1292/2579] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:00 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:31:00.850975 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcad46a-7ccf-4453-ac6b-3e14061ac4c0 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.862283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcad46a-7ccf-4453-ac6b-3e14061ac4c0 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.931365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbc7ce-a3cb-4866-84ba-217130b54195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.932100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbc7ce-a3cb-4866-84ba-217130b54195 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.932418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbc7ce-a3cb-4866-84ba-217130b54195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.932697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbc7ce-a3cb-4866-84ba-217130b54195 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.933387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbc7ce-a3cb-4866-84ba-217130b54195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.935288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbc7ce-a3cb-4866-84ba-217130b54195 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.956005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1288/2580] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:00 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:00.959249 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1716f-b6dd-4d1b-87e2-dd5e286e55e9 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:00.970128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1716f-b6dd-4d1b-87e2-dd5e286e55e9 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:00.974694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fcddc-28b9-4a9a-bc15-6e68d09cf989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:00.975351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fcddc-28b9-4a9a-bc15-6e68d09cf989 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:00.975647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fcddc-28b9-4a9a-bc15-6e68d09cf989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:00.975916 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fcddc-28b9-4a9a-bc15-6e68d09cf989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:00.976698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fcddc-28b9-4a9a-bc15-6e68d09cf989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:00.978285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fcddc-28b9-4a9a-bc15-6e68d09cf989 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:00.989550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1293/2581] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:00.993806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbc7ce-a3cb-4866-84ba-217130b54195 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:01.004179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbc7ce-a3cb-4866-84ba-217130b54195 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:01.009032 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7e171-dd76-4b43-9659-0edad8d2b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:01.009913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7e171-dd76-4b43-9659-0edad8d2b9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:01.010198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7e171-dd76-4b43-9659-0edad8d2b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:01.010506 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7e171-dd76-4b43-9659-0edad8d2b9c4 admin admin] PATH_INFO: `/v3/projects/212fe1a15b6d4e779db6d24ec379850d/users/822e3be1c26d40978dbf5ef7f1cda40e/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:01.028958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7e171-dd76-4b43-9659-0edad8d2b9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=212fe1a15b6d4e779db6d24ec379850d, user_id=822e3be1c26d40978dbf5ef7f1cda40e, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:01.031800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7e171-dd76-4b43-9659-0edad8d2b9c4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:01.045134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1289/2582] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:00 2022] PUT /identity/v3/projects/212fe1a15b6d4e779db6d24ec379850d/users/822e3be1c26d40978dbf5ef7f1cda40e/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:01.049201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fcddc-28b9-4a9a-bc15-6e68d09cf989 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:01.059839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fcddc-28b9-4a9a-bc15-6e68d09cf989 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:01.118006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa2d79-a41c-48be-8b27-d53ce447be1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:01.118621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2d79-a41c-48be-8b27-d53ce447be1e admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:01.118933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2d79-a41c-48be-8b27-d53ce447be1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:01.119250 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2d79-a41c-48be-8b27-d53ce447be1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:01.120566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa2d79-a41c-48be-8b27-d53ce447be1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:01.122179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa2d79-a41c-48be-8b27-d53ce447be1e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:01.132333 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1294/2583] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:31:01.136515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7e171-dd76-4b43-9659-0edad8d2b9c4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:01.146699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7e171-dd76-4b43-9659-0edad8d2b9c4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:01.151311 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd54e8-5e1d-48b6-ac3f-c5d2cbef5235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:01.152238 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd54e8-5e1d-48b6-ac3f-c5d2cbef5235 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:01.152535 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd54e8-5e1d-48b6-ac3f-c5d2cbef5235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:01.152819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd54e8-5e1d-48b6-ac3f-c5d2cbef5235 admin admin] PATH_INFO: `/v3/projects/212fe1a15b6d4e779db6d24ec379850d/users/822e3be1c26d40978dbf5ef7f1cda40e/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:01.154795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd54e8-5e1d-48b6-ac3f-c5d2cbef5235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=212fe1a15b6d4e779db6d24ec379850d, user_id=822e3be1c26d40978dbf5ef7f1cda40e, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:01.157516 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd54e8-5e1d-48b6-ac3f-c5d2cbef5235 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:01.168253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1290/2584] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:01 2022] PUT /identity/v3/projects/212fe1a15b6d4e779db6d24ec379850d/users/822e3be1c26d40978dbf5ef7f1cda40e/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:01.179389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1256ffc-52d1-4612-bceb-1e1303435c3e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:01.179684 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1256ffc-52d1-4612-bceb-1e1303435c3e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:01.179992 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1256ffc-52d1-4612-bceb-1e1303435c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:01.207184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a1256ffc-52d1-4612-bceb-1e1303435c3e None None] MFA Rules not processed for user `822e3be1c26d40978dbf5ef7f1cda40e`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:01.208420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a1256ffc-52d1-4612-bceb-1e1303435c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:01.273921 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1295/2585] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:01.284522 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd54e8-5e1d-48b6-ac3f-c5d2cbef5235 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:01.335045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:01.338839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd54e8-5e1d-48b6-ac3f-c5d2cbef5235 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:01.343380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b658e-56fa-43a6-ab9c-e1db6163616f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:01.344041 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b658e-56fa-43a6-ab9c-e1db6163616f service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:01.344328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b658e-56fa-43a6-ab9c-e1db6163616f service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:01.344610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b658e-56fa-43a6-ab9c-e1db6163616f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:01.353407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b658e-56fa-43a6-ab9c-e1db6163616f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:01.355321 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b658e-56fa-43a6-ab9c-e1db6163616f service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:01.364490 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1291/2586] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:01.846667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1256ffc-52d1-4612-bceb-1e1303435c3e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:01.848163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a1256ffc-52d1-4612-bceb-1e1303435c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:01.860413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1256ffc-52d1-4612-bceb-1e1303435c3e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:01.864110 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d044-17b5-4f11-865e-5ea121b6477c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:01.864878 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d044-17b5-4f11-865e-5ea121b6477c service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:01.865230 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d044-17b5-4f11-865e-5ea121b6477c service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:01.865575 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643d044-17b5-4f11-865e-5ea121b6477c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:01.888628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:01.927746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643d044-17b5-4f11-865e-5ea121b6477c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:01.929241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643d044-17b5-4f11-865e-5ea121b6477c service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:01.938231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1296/2587] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:03.481788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b658e-56fa-43a6-ab9c-e1db6163616f service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:03.481788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f05b658e-56fa-43a6-ab9c-e1db6163616f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:03.542789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b658e-56fa-43a6-ab9c-e1db6163616f service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:03.546467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52907e-98a0-490a-9380-4fb590b3a34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:03.547115 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52907e-98a0-490a-9380-4fb590b3a34b service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:03.547404 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52907e-98a0-490a-9380-4fb590b3a34b service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:03.547683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52907e-98a0-490a-9380-4fb590b3a34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:03.549552 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-dd52907e-98a0-490a-9380-4fb590b3a34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:03.622263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52907e-98a0-490a-9380-4fb590b3a34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:03.623805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52907e-98a0-490a-9380-4fb590b3a34b service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:03.636397 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1292/2588] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:06.207177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d044-17b5-4f11-865e-5ea121b6477c service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:06.216791 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643d044-17b5-4f11-865e-5ea121b6477c service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:06.221039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053fe19-ccd1-4198-9925-ee13a4e3cb52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:06.222162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053fe19-ccd1-4198-9925-ee13a4e3cb52 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:06.222564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053fe19-ccd1-4198-9925-ee13a4e3cb52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:06.222939 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053fe19-ccd1-4198-9925-ee13a4e3cb52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:06.316254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053fe19-ccd1-4198-9925-ee13a4e3cb52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:06.317735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053fe19-ccd1-4198-9925-ee13a4e3cb52 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:06.346454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1297/2589] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:06.846938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52907e-98a0-490a-9380-4fb590b3a34b service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:06.849663 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-dd52907e-98a0-490a-9380-4fb590b3a34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:06.922747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053fe19-ccd1-4198-9925-ee13a4e3cb52 service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:06.924500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5053fe19-ccd1-4198-9925-ee13a4e3cb52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:06.950720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053fe19-ccd1-4198-9925-ee13a4e3cb52 service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:06.955500 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64b84b-53ba-4e9b-903b-3de06f364ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:06.956635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64b84b-53ba-4e9b-903b-3de06f364ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:06.956999 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64b84b-53ba-4e9b-903b-3de06f364ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:06.957361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64b84b-53ba-4e9b-903b-3de06f364ef0 admin admin] PATH_INFO: `/v3/users/71cddd4efaaf4298934a4f601d746175` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:06.959295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64b84b-53ba-4e9b-903b-3de06f364ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71cddd4efaaf4298934a4f601d746175)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:06.964474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64b84b-53ba-4e9b-903b-3de06f364ef0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:06.968558 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52907e-98a0-490a-9380-4fb590b3a34b service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:06.980433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26a57a-0b43-4450-aa70-40c5ae889a44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dde39c6d85446a681dea24573f0d6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:06.981684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a57a-0b43-4450-aa70-40c5ae889a44 service placement] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:06.981984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a57a-0b43-4450-aa70-40c5ae889a44 service placement] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:06.982404 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a57a-0b43-4450-aa70-40c5ae889a44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:06.985915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0d26a57a-0b43-4450-aa70-40c5ae889a44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:07.009738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26a57a-0b43-4450-aa70-40c5ae889a44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:07.012312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26a57a-0b43-4450-aa70-40c5ae889a44 service placement] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:07.025459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1293/2590] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:07.053529 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ba64b84b-53ba-4e9b-903b-3de06f364ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71cddd4efaaf4298934a4f601d746175'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:07.054398 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ba64b84b-53ba-4e9b-903b-3de06f364ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71cddd4efaaf4298934a4f601d746175'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:07.072070 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ba64b84b-53ba-4e9b-903b-3de06f364ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71cddd4efaaf4298934a4f601d746175'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:07.073765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ba64b84b-53ba-4e9b-903b-3de06f364ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71cddd4efaaf4298934a4f601d746175'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:07.084326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ba64b84b-53ba-4e9b-903b-3de06f364ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71cddd4efaaf4298934a4f601d746175'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:07.105773 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1298/2591] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:06 2022] DELETE /identity/v3/users/71cddd4efaaf4298934a4f601d746175 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:07.301023 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26a57a-0b43-4450-aa70-40c5ae889a44 service placement] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:07.328610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26a57a-0b43-4450-aa70-40c5ae889a44 service placement] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:07.359448 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:07.390452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:07.391367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:07.391655 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:07.391928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] PATH_INFO: `/v3/projects/834a8fb1b8d349fcb961857368bec767` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:07.393613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=834a8fb1b8d349fcb961857368bec767)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:07.395563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:07.448768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834a8fb1b8d349fcb961857368bec767', 'request_id': 'req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:07.455979 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834a8fb1b8d349fcb961857368bec767', 'request_id': 'req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:07.461508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834a8fb1b8d349fcb961857368bec767', 'request_id': 'req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:07.472625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] The token cache is being invalidate because project 834a8fb1b8d349fcb961857368bec767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:07.472914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:07.473580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-4d8dc8ad-cb5b-4b18-94a8-e6817f0fa851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:07.475168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1294/2592] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:07 2022] DELETE /identity/v3/projects/834a8fb1b8d349fcb961857368bec767 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:07.480344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7302-78d5-4135-82ef-897a0fb5c775 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:07.480830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7302-78d5-4135-82ef-897a0fb5c775 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:07.481061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e7302-78d5-4135-82ef-897a0fb5c775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:07.505964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-ca3e7302-78d5-4135-82ef-897a0fb5c775 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:07.507231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ca3e7302-78d5-4135-82ef-897a0fb5c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:07.537322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:07.575102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1299/2593] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:07.584459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3535f-bf20-4eb1-871b-245d565f95aa None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:07.584988 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3535f-bf20-4eb1-871b-245d565f95aa None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:07.585296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3535f-bf20-4eb1-871b-245d565f95aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:07.610944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-05c3535f-bf20-4eb1-871b-245d565f95aa None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:07.612180 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-05c3535f-bf20-4eb1-871b-245d565f95aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:07.620507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1295/2594] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:07.624762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e7302-78d5-4135-82ef-897a0fb5c775 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:07.634345 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e7302-78d5-4135-82ef-897a0fb5c775 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:07.639871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54a373-2271-4df9-9cf3-a6afe86f783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:07.640579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54a373-2271-4df9-9cf3-a6afe86f783f admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:07.640867 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54a373-2271-4df9-9cf3-a6afe86f783f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:07.641148 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54a373-2271-4df9-9cf3-a6afe86f783f admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:07.641875 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54a373-2271-4df9-9cf3-a6afe86f783f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:31:07.642229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54a373-2271-4df9-9cf3-a6afe86f783f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:07.643860 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54a373-2271-4df9-9cf3-a6afe86f783f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:07.655243 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1300/2595] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:31:07.660263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3535f-bf20-4eb1-871b-245d565f95aa None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:07.670136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3535f-bf20-4eb1-871b-245d565f95aa None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:07.674834 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197b5ba-345f-4fe2-9818-9619343a0194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:07.675481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197b5ba-345f-4fe2-9818-9619343a0194 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:07.675765 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197b5ba-345f-4fe2-9818-9619343a0194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:07.676067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197b5ba-345f-4fe2-9818-9619343a0194 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:07.676794 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197b5ba-345f-4fe2-9818-9619343a0194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:07.678661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197b5ba-345f-4fe2-9818-9619343a0194 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:07.714204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1296/2596] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:07 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:07.717824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54a373-2271-4df9-9cf3-a6afe86f783f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:07.728065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54a373-2271-4df9-9cf3-a6afe86f783f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:07.785643 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060848a4-a48d-43be-aadf-53c091adae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:07.786323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060848a4-a48d-43be-aadf-53c091adae5e admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:07.786614 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060848a4-a48d-43be-aadf-53c091adae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:07.786927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060848a4-a48d-43be-aadf-53c091adae5e admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:07.787618 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060848a4-a48d-43be-aadf-53c091adae5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:07.789636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060848a4-a48d-43be-aadf-53c091adae5e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:07.809728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1301/2597] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:07 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:07.813885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197b5ba-345f-4fe2-9818-9619343a0194 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:07.824949 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197b5ba-345f-4fe2-9818-9619343a0194 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:07.829492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ff4e4-b6bc-4129-8a97-909e809fb2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:07.830166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff4e4-b6bc-4129-8a97-909e809fb2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:07.830448 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff4e4-b6bc-4129-8a97-909e809fb2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:07.830724 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff4e4-b6bc-4129-8a97-909e809fb2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:07.831444 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ff4e4-b6bc-4129-8a97-909e809fb2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:07.833050 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ff4e4-b6bc-4129-8a97-909e809fb2b0 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:07.843726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1297/2598] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:31:07.847608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060848a4-a48d-43be-aadf-53c091adae5e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:07.857898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060848a4-a48d-43be-aadf-53c091adae5e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:07.862448 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7d5ee-e7b6-4c10-a90d-b77a839ddd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:07.863098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7d5ee-e7b6-4c10-a90d-b77a839ddd35 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:07.863384 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7d5ee-e7b6-4c10-a90d-b77a839ddd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:07.863671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7d5ee-e7b6-4c10-a90d-b77a839ddd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:07.864434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7d5ee-e7b6-4c10-a90d-b77a839ddd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:07.866016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7d5ee-e7b6-4c10-a90d-b77a839ddd35 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:07.876373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1302/2599] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:07.880415 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ff4e4-b6bc-4129-8a97-909e809fb2b0 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:07.890095 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ff4e4-b6bc-4129-8a97-909e809fb2b0 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:07.894632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db079eb-ba68-45aa-9045-7e36e14d351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:07.895540 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db079eb-ba68-45aa-9045-7e36e14d351c admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:07.895865 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db079eb-ba68-45aa-9045-7e36e14d351c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:07.896265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db079eb-ba68-45aa-9045-7e36e14d351c admin admin] PATH_INFO: `/v3/projects/a930035c72fa488081809aa7f64e0e7f/users/7c5973bf1342476880e749953c6518e3/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:07.912343 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db079eb-ba68-45aa-9045-7e36e14d351c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a930035c72fa488081809aa7f64e0e7f, user_id=7c5973bf1342476880e749953c6518e3, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:07.914300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db079eb-ba68-45aa-9045-7e36e14d351c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:07.928476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1298/2600] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:07 2022] PUT /identity/v3/projects/a930035c72fa488081809aa7f64e0e7f/users/7c5973bf1342476880e749953c6518e3/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:07.939086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012471f-610a-473c-b0c1-a6beb04f2f3f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:07.939386 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012471f-610a-473c-b0c1-a6beb04f2f3f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:07.939676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012471f-610a-473c-b0c1-a6beb04f2f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:07.966187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f012471f-610a-473c-b0c1-a6beb04f2f3f None None] MFA Rules not processed for user `7c5973bf1342476880e749953c6518e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:07.967491 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f012471f-610a-473c-b0c1-a6beb04f2f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:08.038729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1303/2601] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:08.043732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db079eb-ba68-45aa-9045-7e36e14d351c admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:08.100913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:08.105540 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db079eb-ba68-45aa-9045-7e36e14d351c admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:08.111703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5e64a-06a1-4c5b-a3f2-c2cc86fff456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:08.112404 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5e64a-06a1-4c5b-a3f2-c2cc86fff456 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.112882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5e64a-06a1-4c5b-a3f2-c2cc86fff456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.113330 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5e64a-06a1-4c5b-a3f2-c2cc86fff456 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.114024 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5e64a-06a1-4c5b-a3f2-c2cc86fff456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:08.115910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5e64a-06a1-4c5b-a3f2-c2cc86fff456 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:08.140458 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1299/2602] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:08 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:08.144484 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012471f-610a-473c-b0c1-a6beb04f2f3f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:08.155347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012471f-610a-473c-b0c1-a6beb04f2f3f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:08.181055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:08.213120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9b8f7-8bef-4a5a-9986-a9a26a1e2e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:08.214288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9b8f7-8bef-4a5a-9986-a9a26a1e2e4d admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.214597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9b8f7-8bef-4a5a-9986-a9a26a1e2e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.214898 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9b8f7-8bef-4a5a-9986-a9a26a1e2e4d admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.215595 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9b8f7-8bef-4a5a-9986-a9a26a1e2e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:08.217543 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9b8f7-8bef-4a5a-9986-a9a26a1e2e4d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:08.236860 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1304/2603] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:08 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:08.240842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5e64a-06a1-4c5b-a3f2-c2cc86fff456 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:08.250931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5e64a-06a1-4c5b-a3f2-c2cc86fff456 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:08.255456 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef4ebd-7a1b-4f48-868a-fadcdf4bef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:08.256145 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4ebd-7a1b-4f48-868a-fadcdf4bef03 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.256434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4ebd-7a1b-4f48-868a-fadcdf4bef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.256715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef4ebd-7a1b-4f48-868a-fadcdf4bef03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.257436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef4ebd-7a1b-4f48-868a-fadcdf4bef03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:08.259021 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef4ebd-7a1b-4f48-868a-fadcdf4bef03 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:08.269312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1300/2604] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:08.273158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9b8f7-8bef-4a5a-9986-a9a26a1e2e4d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:08.283474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9b8f7-8bef-4a5a-9986-a9a26a1e2e4d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:08.288982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5e018-38f5-488b-8d46-3bb6d0bb2e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:08.289471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5e018-38f5-488b-8d46-3bb6d0bb2e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.289758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5e018-38f5-488b-8d46-3bb6d0bb2e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.290040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5e018-38f5-488b-8d46-3bb6d0bb2e8f admin admin] PATH_INFO: `/v3/projects/d0c1ae1a7ff341c9a5240c7124eb627b/users/8958b5aa0cf14c0983e29cfe79927682/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.305804 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5e018-38f5-488b-8d46-3bb6d0bb2e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c1ae1a7ff341c9a5240c7124eb627b, user_id=8958b5aa0cf14c0983e29cfe79927682, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:08.308801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5e018-38f5-488b-8d46-3bb6d0bb2e8f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:08.322606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1305/2605] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:08 2022] PUT /identity/v3/projects/d0c1ae1a7ff341c9a5240c7124eb627b/users/8958b5aa0cf14c0983e29cfe79927682/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:08.326536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef4ebd-7a1b-4f48-868a-fadcdf4bef03 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:08.336498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef4ebd-7a1b-4f48-868a-fadcdf4bef03 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:08.397569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e7d09-f5c7-4bd9-909e-5a3b383a5e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:08.398244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e7d09-f5c7-4bd9-909e-5a3b383a5e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.398523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e7d09-f5c7-4bd9-909e-5a3b383a5e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.398807 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e7d09-f5c7-4bd9-909e-5a3b383a5e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.399529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e7d09-f5c7-4bd9-909e-5a3b383a5e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:08.401669 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e7d09-f5c7-4bd9-909e-5a3b383a5e7e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:08.412315 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1301/2606] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:08.417365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5e018-38f5-488b-8d46-3bb6d0bb2e8f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:08.427407 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5e018-38f5-488b-8d46-3bb6d0bb2e8f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:08.432315 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3744fc3-7616-42fa-bd2a-e09e24d09292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:08.433328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3744fc3-7616-42fa-bd2a-e09e24d09292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.433674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3744fc3-7616-42fa-bd2a-e09e24d09292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.434024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3744fc3-7616-42fa-bd2a-e09e24d09292 admin admin] PATH_INFO: `/v3/projects/d0c1ae1a7ff341c9a5240c7124eb627b/users/8958b5aa0cf14c0983e29cfe79927682/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.436516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3744fc3-7616-42fa-bd2a-e09e24d09292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c1ae1a7ff341c9a5240c7124eb627b, user_id=8958b5aa0cf14c0983e29cfe79927682, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:08.439326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3744fc3-7616-42fa-bd2a-e09e24d09292 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:08.450422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1306/2607] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:08 2022] PUT /identity/v3/projects/d0c1ae1a7ff341c9a5240c7124eb627b/users/8958b5aa0cf14c0983e29cfe79927682/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:08.460652 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053d55-537a-4698-aa11-3dbc54b530e6 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.461229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053d55-537a-4698-aa11-3dbc54b530e6 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.461510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053d55-537a-4698-aa11-3dbc54b530e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.488331 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0f053d55-537a-4698-aa11-3dbc54b530e6 None None] MFA Rules not processed for user `8958b5aa0cf14c0983e29cfe79927682`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:08.489538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0f053d55-537a-4698-aa11-3dbc54b530e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:08.559046 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1302/2608] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:08.571074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3744fc3-7616-42fa-bd2a-e09e24d09292 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:08.573551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b3744fc3-7616-42fa-bd2a-e09e24d09292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:08.634404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3744fc3-7616-42fa-bd2a-e09e24d09292 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:08.637983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ba4e-aa59-4e81-8a7a-e7e7b26135a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:08.638627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ba4e-aa59-4e81-8a7a-e7e7b26135a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.638911 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ba4e-aa59-4e81-8a7a-e7e7b26135a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.639189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ba4e-aa59-4e81-8a7a-e7e7b26135a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.654004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2ba4e-aa59-4e81-8a7a-e7e7b26135a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:08.655446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2ba4e-aa59-4e81-8a7a-e7e7b26135a5 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:08.669965 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1307/2609] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:08.723408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053d55-537a-4698-aa11-3dbc54b530e6 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:08.725306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0f053d55-537a-4698-aa11-3dbc54b530e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:08.759943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ba4e-aa59-4e81-8a7a-e7e7b26135a5 service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:08.769317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ba4e-aa59-4e81-8a7a-e7e7b26135a5 service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:08.774251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a866909-e3b2-4fdb-a3cc-27bf6dcc4bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:08.774919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a866909-e3b2-4fdb-a3cc-27bf6dcc4bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.775212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a866909-e3b2-4fdb-a3cc-27bf6dcc4bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.775499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a866909-e3b2-4fdb-a3cc-27bf6dcc4bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.798816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:08.813748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053d55-537a-4698-aa11-3dbc54b530e6 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:08.818807 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:08.819685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.820007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.820303 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] PATH_INFO: `/v3/users/d9edce4197244b9287d29980ffaf18c4` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.821544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9edce4197244b9287d29980ffaf18c4)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:08.823505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:08.838678 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a866909-e3b2-4fdb-a3cc-27bf6dcc4bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:08.840202 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a866909-e3b2-4fdb-a3cc-27bf6dcc4bb5 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:08.850286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1308/2610] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:08.871546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9edce4197244b9287d29980ffaf18c4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:08.884583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9edce4197244b9287d29980ffaf18c4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:08.885250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9edce4197244b9287d29980ffaf18c4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:08.893318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9edce4197244b9287d29980ffaf18c4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:08.905910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9edce4197244b9287d29980ffaf18c4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:08.912127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1303/2611] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:08 2022] DELETE /identity/v3/users/d9edce4197244b9287d29980ffaf18c4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:08.917545 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4d57f-a2dd-4771-80fc-fb4c7820a79c None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.917873 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4d57f-a2dd-4771-80fc-fb4c7820a79c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.918161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4d57f-a2dd-4771-80fc-fb4c7820a79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.936305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-2dd4d57f-a2dd-4771-80fc-fb4c7820a79c None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:08.937652 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-2dd4d57f-a2dd-4771-80fc-fb4c7820a79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:08.956441 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:09.015258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1309/2612] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:09.028178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:09.029606 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:09.087324 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8029cb-c053-46e4-b59f-aacf5d8ad0ef admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:09.091063 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beecd8-fbb0-4aa7-8897-48c38d7858ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:09.091712 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beecd8-fbb0-4aa7-8897-48c38d7858ac service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:09.092030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beecd8-fbb0-4aa7-8897-48c38d7858ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:09.092315 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beecd8-fbb0-4aa7-8897-48c38d7858ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:09.101670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5beecd8-fbb0-4aa7-8897-48c38d7858ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:09.104157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5beecd8-fbb0-4aa7-8897-48c38d7858ac service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:09.114094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1304/2613] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:09.383715 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4d57f-a2dd-4771-80fc-fb4c7820a79c None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:09.385722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-2dd4d57f-a2dd-4771-80fc-fb4c7820a79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:09.398950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4d57f-a2dd-4771-80fc-fb4c7820a79c None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:09.404347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:09.405220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:09.405524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:09.405784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] PATH_INFO: `/v3/projects/b2bd6db173b9476c9828f43ae15c6b19` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:09.406963 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2bd6db173b9476c9828f43ae15c6b19)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:09.408902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:09.455339 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2bd6db173b9476c9828f43ae15c6b19', 'request_id': 'req-6375b647-fe2a-4a2a-b3a7-66747e5d053f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:09.462524 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2bd6db173b9476c9828f43ae15c6b19', 'request_id': 'req-6375b647-fe2a-4a2a-b3a7-66747e5d053f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:09.468708 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2bd6db173b9476c9828f43ae15c6b19', 'request_id': 'req-6375b647-fe2a-4a2a-b3a7-66747e5d053f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:09.479686 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] The token cache is being invalidate because project b2bd6db173b9476c9828f43ae15c6b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:09.480005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:09.480659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:09.482203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1310/2614] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:09 2022] DELETE /identity/v3/projects/b2bd6db173b9476c9828f43ae15c6b19 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:09.486268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beecd8-fbb0-4aa7-8897-48c38d7858ac service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:09.495826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beecd8-fbb0-4aa7-8897-48c38d7858ac service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:09.552572 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:09.553437 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:09.553728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:09.554010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] PATH_INFO: `/v3/users/9c5b8baa023e40d2b79dc9f673f7eee1` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:09.555201 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c5b8baa023e40d2b79dc9f673f7eee1)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:09.557146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:09.572144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:09.604921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c5b8baa023e40d2b79dc9f673f7eee1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:09.616657 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c5b8baa023e40d2b79dc9f673f7eee1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:09.617329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c5b8baa023e40d2b79dc9f673f7eee1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:09.624325 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c5b8baa023e40d2b79dc9f673f7eee1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:09.631144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c5b8baa023e40d2b79dc9f673f7eee1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:09.637510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1305/2615] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:09 2022] DELETE /identity/v3/users/9c5b8baa023e40d2b79dc9f673f7eee1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:09.918919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:09.920518 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:09.938499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375b647-fe2a-4a2a-b3a7-66747e5d053f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:09.997479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:09.998652 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:09.998947 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:09.999509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] PATH_INFO: `/v3/projects/053ae92ee81e4f64a2a8ba38924cac5a` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:10.001059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=053ae92ee81e4f64a2a8ba38924cac5a)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:10.003134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:10.064235 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:10.065751 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053ae92ee81e4f64a2a8ba38924cac5a', 'request_id': 'req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.075159 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053ae92ee81e4f64a2a8ba38924cac5a', 'request_id': 'req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.081190 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053ae92ee81e4f64a2a8ba38924cac5a', 'request_id': 'req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.095031 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] The token cache is being invalidate because project 053ae92ee81e4f64a2a8ba38924cac5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:10.095330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.096149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.098636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1311/2616] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:09 2022] DELETE /identity/v3/projects/053ae92ee81e4f64a2a8ba38924cac5a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:10.102455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:10.104591 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:10.117153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd8319-3b94-431d-a015-d71eb8b48f5b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:10.178936 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd2c4a-e6eb-4725-86a0-6fbd6bb4e1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:10.179893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2c4a-e6eb-4725-86a0-6fbd6bb4e1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:10.180202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2c4a-e6eb-4725-86a0-6fbd6bb4e1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:10.180510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd2c4a-e6eb-4725-86a0-6fbd6bb4e1ea admin admin] PATH_INFO: `/v3/users/822e3be1c26d40978dbf5ef7f1cda40e` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:10.181690 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd2c4a-e6eb-4725-86a0-6fbd6bb4e1ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=822e3be1c26d40978dbf5ef7f1cda40e)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:10.184296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd2c4a-e6eb-4725-86a0-6fbd6bb4e1ea admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:10.246637 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b5bd2c4a-e6eb-4725-86a0-6fbd6bb4e1ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822e3be1c26d40978dbf5ef7f1cda40e'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.259198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b5bd2c4a-e6eb-4725-86a0-6fbd6bb4e1ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822e3be1c26d40978dbf5ef7f1cda40e'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.259884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b5bd2c4a-e6eb-4725-86a0-6fbd6bb4e1ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822e3be1c26d40978dbf5ef7f1cda40e'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.267575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b5bd2c4a-e6eb-4725-86a0-6fbd6bb4e1ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822e3be1c26d40978dbf5ef7f1cda40e'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.275429 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b5bd2c4a-e6eb-4725-86a0-6fbd6bb4e1ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822e3be1c26d40978dbf5ef7f1cda40e'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.285357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1306/2617] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:10 2022] DELETE /identity/v3/users/822e3be1c26d40978dbf5ef7f1cda40e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:10.568579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:10.570200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:10.584737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f57f4-ab45-40f3-99df-ae4054ba8f0e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:10.642852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:10.643714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:10.644027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:10.644306 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] PATH_INFO: `/v3/projects/212fe1a15b6d4e779db6d24ec379850d` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:10.645479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212fe1a15b6d4e779db6d24ec379850d)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:10.647368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:10.693769 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212fe1a15b6d4e779db6d24ec379850d', 'request_id': 'req-71d3444b-bed5-4de5-9eaf-782e27d586d9'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.701021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212fe1a15b6d4e779db6d24ec379850d', 'request_id': 'req-71d3444b-bed5-4de5-9eaf-782e27d586d9'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.706752 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212fe1a15b6d4e779db6d24ec379850d', 'request_id': 'req-71d3444b-bed5-4de5-9eaf-782e27d586d9'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.718400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] The token cache is being invalidate because project 212fe1a15b6d4e779db6d24ec379850d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:10.718693 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.719341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-71d3444b-bed5-4de5-9eaf-782e27d586d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:10.720925 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1312/2618] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:10 2022] DELETE /identity/v3/projects/212fe1a15b6d4e779db6d24ec379850d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:10.727926 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064a6a9-40fa-4f62-a8de-d8e92fb3a8a2 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:10.728232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064a6a9-40fa-4f62-a8de-d8e92fb3a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:10.728514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064a6a9-40fa-4f62-a8de-d8e92fb3a8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:10.748014 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4064a6a9-40fa-4f62-a8de-d8e92fb3a8a2 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:10.749222 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4064a6a9-40fa-4f62-a8de-d8e92fb3a8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:10.757492 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:10.809634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1307/2619] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:10.818073 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d1dee-f22e-4ce0-9c5d-6076e4e3ed97 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:10.818367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d1dee-f22e-4ce0-9c5d-6076e4e3ed97 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:10.818647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d1dee-f22e-4ce0-9c5d-6076e4e3ed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:10.838904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-538d1dee-f22e-4ce0-9c5d-6076e4e3ed97 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:10.840163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-538d1dee-f22e-4ce0-9c5d-6076e4e3ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:10.848066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1313/2620] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:10.852186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064a6a9-40fa-4f62-a8de-d8e92fb3a8a2 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:10.861799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064a6a9-40fa-4f62-a8de-d8e92fb3a8a2 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:10.866251 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434ecab-e3b4-450f-8d94-4fb24e6560e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:10.866895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434ecab-e3b4-450f-8d94-4fb24e6560e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:10.867176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434ecab-e3b4-450f-8d94-4fb24e6560e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:10.867453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434ecab-e3b4-450f-8d94-4fb24e6560e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:10.868199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434ecab-e3b4-450f-8d94-4fb24e6560e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:31:10.868509 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434ecab-e3b4-450f-8d94-4fb24e6560e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:10.870211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434ecab-e3b4-450f-8d94-4fb24e6560e4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:10.881536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1308/2621] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:31:10.886047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d1dee-f22e-4ce0-9c5d-6076e4e3ed97 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:10.895203 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d1dee-f22e-4ce0-9c5d-6076e4e3ed97 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:10.901507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e453-5b3e-4099-823c-1732c2b2f526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:10.902248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e453-5b3e-4099-823c-1732c2b2f526 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:10.902619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e453-5b3e-4099-823c-1732c2b2f526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:10.903061 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e453-5b3e-4099-823c-1732c2b2f526 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:10.903839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3e453-5b3e-4099-823c-1732c2b2f526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:10.906079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3e453-5b3e-4099-823c-1732c2b2f526 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:10.938854 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1314/2622] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:10 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:31:10.940333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434ecab-e3b4-450f-8d94-4fb24e6560e4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:10.943767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e453-5b3e-4099-823c-1732c2b2f526 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:10.945453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-47b3e453-5b3e-4099-823c-1732c2b2f526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:10.951403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434ecab-e3b4-450f-8d94-4fb24e6560e4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:10.987034 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:11.012555 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e453-5b3e-4099-823c-1732c2b2f526 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:11.014520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92861402-5260-4c35-b67d-fc8df7ee5f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:11.015227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92861402-5260-4c35-b67d-fc8df7ee5f7b admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.015511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92861402-5260-4c35-b67d-fc8df7ee5f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.015786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92861402-5260-4c35-b67d-fc8df7ee5f7b admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.016506 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92861402-5260-4c35-b67d-fc8df7ee5f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:11.018423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92861402-5260-4c35-b67d-fc8df7ee5f7b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:11.028042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588f991-006e-4b93-9799-79a64db4779e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:11.028948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588f991-006e-4b93-9799-79a64db4779e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.029240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588f991-006e-4b93-9799-79a64db4779e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.029527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588f991-006e-4b93-9799-79a64db4779e admin admin] PATH_INFO: `/v3/users/891a761def1f4618b2678a62a8dd7c9c` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.030846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588f991-006e-4b93-9799-79a64db4779e admin admin] RBAC: Authorizing `identity:delete_user(user_id=891a761def1f4618b2678a62a8dd7c9c)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:11.032886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588f991-006e-4b93-9799-79a64db4779e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:11.049680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1309/2623] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:10 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:11.053681 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92861402-5260-4c35-b67d-fc8df7ee5f7b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:11.067630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92861402-5260-4c35-b67d-fc8df7ee5f7b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:11.073406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381f08b-d9b9-4fe5-9411-d4c5dc41d679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:11.074075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381f08b-d9b9-4fe5-9411-d4c5dc41d679 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.074361 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381f08b-d9b9-4fe5-9411-d4c5dc41d679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.074636 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381f08b-d9b9-4fe5-9411-d4c5dc41d679 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.075359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381f08b-d9b9-4fe5-9411-d4c5dc41d679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:11.076994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381f08b-d9b9-4fe5-9411-d4c5dc41d679 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:11.085102 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1588f991-006e-4b93-9799-79a64db4779e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891a761def1f4618b2678a62a8dd7c9c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:11.085765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1588f991-006e-4b93-9799-79a64db4779e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891a761def1f4618b2678a62a8dd7c9c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:11.087121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1310/2624] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:11.091643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381f08b-d9b9-4fe5-9411-d4c5dc41d679 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:11.099671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1588f991-006e-4b93-9799-79a64db4779e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891a761def1f4618b2678a62a8dd7c9c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:11.100531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1588f991-006e-4b93-9799-79a64db4779e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891a761def1f4618b2678a62a8dd7c9c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:11.102091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381f08b-d9b9-4fe5-9411-d4c5dc41d679 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:11.108071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b5d9c-fad3-4932-bc49-4adb8ed80468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:11.108736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-1588f991-006e-4b93-9799-79a64db4779e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891a761def1f4618b2678a62a8dd7c9c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:11.108847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5d9c-fad3-4932-bc49-4adb8ed80468 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.109079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5d9c-fad3-4932-bc49-4adb8ed80468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.109417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5d9c-fad3-4932-bc49-4adb8ed80468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.110153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b5d9c-fad3-4932-bc49-4adb8ed80468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:11.111884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b5d9c-fad3-4932-bc49-4adb8ed80468 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:11.120870 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1315/2625] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:10 2022] DELETE /identity/v3/users/891a761def1f4618b2678a62a8dd7c9c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:11.126189 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1311/2626] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:31:11.126337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3f357-bf86-421b-ab86-fe8676adfae3 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.126337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3f357-bf86-421b-ab86-fe8676adfae3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.126337 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3f357-bf86-421b-ab86-fe8676adfae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.127134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b5d9c-fad3-4932-bc49-4adb8ed80468 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:11.128857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-884b5d9c-fad3-4932-bc49-4adb8ed80468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:11.141853 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b5d9c-fad3-4932-bc49-4adb8ed80468 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:11.143417 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-61e3f357-bf86-421b-ab86-fe8676adfae3 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:11.144660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-61e3f357-bf86-421b-ab86-fe8676adfae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:11.201052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea3d01-b1cc-4333-9e49-6dbe181dd7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:11.201967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea3d01-b1cc-4333-9e49-6dbe181dd7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.202253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea3d01-b1cc-4333-9e49-6dbe181dd7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.202543 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea3d01-b1cc-4333-9e49-6dbe181dd7dc admin admin] PATH_INFO: `/v3/projects/5ee343ab10574b168f25dd1ab090d615/users/0918cc91d5874809857526485a8e73af/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.205088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1316/2627] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:11.214539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:11.214716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3f357-bf86-421b-ab86-fe8676adfae3 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:11.216096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-61e3f357-bf86-421b-ab86-fe8676adfae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:11.217407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea3d01-b1cc-4333-9e49-6dbe181dd7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee343ab10574b168f25dd1ab090d615, user_id=0918cc91d5874809857526485a8e73af, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:11.220141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea3d01-b1cc-4333-9e49-6dbe181dd7dc admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:11.233134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1312/2628] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:11 2022] PUT /identity/v3/projects/5ee343ab10574b168f25dd1ab090d615/users/0918cc91d5874809857526485a8e73af/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:11.238131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865628f-c78a-4f45-95f7-3da281f5ca84 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.238418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865628f-c78a-4f45-95f7-3da281f5ca84 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.238709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865628f-c78a-4f45-95f7-3da281f5ca84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.256547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0865628f-c78a-4f45-95f7-3da281f5ca84 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:11.257822 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0865628f-c78a-4f45-95f7-3da281f5ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:11.275040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3f357-bf86-421b-ab86-fe8676adfae3 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:11.284209 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:11.317480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1313/2629] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:11.327474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f98806-d31e-4cf4-a0c3-0aba6104a590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:11.327917 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865628f-c78a-4f45-95f7-3da281f5ca84 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:11.328175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f98806-d31e-4cf4-a0c3-0aba6104a590 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.328472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f98806-d31e-4cf4-a0c3-0aba6104a590 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.328790 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f98806-d31e-4cf4-a0c3-0aba6104a590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.337181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865628f-c78a-4f45-95f7-3da281f5ca84 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:11.338177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f98806-d31e-4cf4-a0c3-0aba6104a590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:11.339651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f98806-d31e-4cf4-a0c3-0aba6104a590 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:11.341271 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569b19b-df20-40d8-99e1-48f3083eb2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:11.341908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b19b-df20-40d8-99e1-48f3083eb2ff service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.342190 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b19b-df20-40d8-99e1-48f3083eb2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.342462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b19b-df20-40d8-99e1-48f3083eb2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.349739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1317/2630] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:31:11.351930 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569b19b-df20-40d8-99e1-48f3083eb2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:11.353399 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569b19b-df20-40d8-99e1-48f3083eb2ff service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:11.363911 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1314/2631] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:31:11.740779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f98806-d31e-4cf4-a0c3-0aba6104a590 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:11.742362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-12f98806-d31e-4cf4-a0c3-0aba6104a590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:11.768782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f98806-d31e-4cf4-a0c3-0aba6104a590 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:11.775427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:11.776474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:11.776820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:11.777355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] PATH_INFO: `/v3/projects/aba1ddc6cb6b4035a6d337bed861fc7f` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:11.780178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba1ddc6cb6b4035a6d337bed861fc7f)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:11.782571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:11.843067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba1ddc6cb6b4035a6d337bed861fc7f', 'request_id': 'req-01210729-99c1-4084-859f-b36905d9d708'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:11.853344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba1ddc6cb6b4035a6d337bed861fc7f', 'request_id': 'req-01210729-99c1-4084-859f-b36905d9d708'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:11.861557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba1ddc6cb6b4035a6d337bed861fc7f', 'request_id': 'req-01210729-99c1-4084-859f-b36905d9d708'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:11.874650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] The token cache is being invalidate because project aba1ddc6cb6b4035a6d337bed861fc7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:11.874982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:11.875589 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:11.877382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1318/2632] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:11 2022] DELETE /identity/v3/projects/aba1ddc6cb6b4035a6d337bed861fc7f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:12.112175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d1ee-12ed-46b5-8560-b2303afaa6fc None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:12.113085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d1ee-12ed-46b5-8560-b2303afaa6fc None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:12.113564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d1ee-12ed-46b5-8560-b2303afaa6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:12.142449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7022d1ee-12ed-46b5-8560-b2303afaa6fc None None] MFA Rules not processed for user `0918cc91d5874809857526485a8e73af`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:12.143687 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7022d1ee-12ed-46b5-8560-b2303afaa6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:12.214611 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1315/2633] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:12.219264 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:12.220868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:12.286215 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01210729-99c1-4084-859f-b36905d9d708 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:12.290739 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158739d9-6c2f-4269-9cf8-cfb90f32ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:12.292021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158739d9-6c2f-4269-9cf8-cfb90f32ae9c admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:12.292310 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158739d9-6c2f-4269-9cf8-cfb90f32ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:12.292586 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158739d9-6c2f-4269-9cf8-cfb90f32ae9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:12.293288 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158739d9-6c2f-4269-9cf8-cfb90f32ae9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:12.295179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158739d9-6c2f-4269-9cf8-cfb90f32ae9c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:12.323666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1319/2634] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:12 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:12.327691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022d1ee-12ed-46b5-8560-b2303afaa6fc None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:12.339382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022d1ee-12ed-46b5-8560-b2303afaa6fc None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:12.400344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80c93-7ce4-4a84-afee-49862ca32387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:12.401067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80c93-7ce4-4a84-afee-49862ca32387 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:12.401357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80c93-7ce4-4a84-afee-49862ca32387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:12.401669 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80c93-7ce4-4a84-afee-49862ca32387 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:12.402394 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede80c93-7ce4-4a84-afee-49862ca32387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:12.404545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede80c93-7ce4-4a84-afee-49862ca32387 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:12.421640 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:12.429637 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1316/2635] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:12 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:12.434382 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158739d9-6c2f-4269-9cf8-cfb90f32ae9c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:12.444897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158739d9-6c2f-4269-9cf8-cfb90f32ae9c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:12.449592 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ca627-8f88-4d8d-ae2f-7d5b0bbdc616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:12.450287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca627-8f88-4d8d-ae2f-7d5b0bbdc616 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:12.450579 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca627-8f88-4d8d-ae2f-7d5b0bbdc616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:12.450868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ca627-8f88-4d8d-ae2f-7d5b0bbdc616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:12.451602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ca627-8f88-4d8d-ae2f-7d5b0bbdc616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:12.453273 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ca627-8f88-4d8d-ae2f-7d5b0bbdc616 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:12.463199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1320/2636] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:31:12.467339 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80c93-7ce4-4a84-afee-49862ca32387 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:12.477504 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80c93-7ce4-4a84-afee-49862ca32387 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:12.482704 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659f63-2f77-4c84-af1c-2f99876e07f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:12.483581 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659f63-2f77-4c84-af1c-2f99876e07f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:12.483869 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659f63-2f77-4c84-af1c-2f99876e07f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:12.484185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659f63-2f77-4c84-af1c-2f99876e07f5 admin admin] PATH_INFO: `/v3/projects/5f77f707c05249f2b40bbf59ccb5f2db/users/1f8164a201ce4861938fbe9b0d14692f/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:12.499228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa659f63-2f77-4c84-af1c-2f99876e07f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f77f707c05249f2b40bbf59ccb5f2db, user_id=1f8164a201ce4861938fbe9b0d14692f, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:12.502480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa659f63-2f77-4c84-af1c-2f99876e07f5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:12.514934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1317/2637] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:12 2022] PUT /identity/v3/projects/5f77f707c05249f2b40bbf59ccb5f2db/users/1f8164a201ce4861938fbe9b0d14692f/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:12.518748 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ca627-8f88-4d8d-ae2f-7d5b0bbdc616 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:12.528646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ca627-8f88-4d8d-ae2f-7d5b0bbdc616 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:12.537335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:12.585685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b675a2a-c0db-49ff-8f69-0d0454f30c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:12.586354 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b675a2a-c0db-49ff-8f69-0d0454f30c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:12.586647 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b675a2a-c0db-49ff-8f69-0d0454f30c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:12.586930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b675a2a-c0db-49ff-8f69-0d0454f30c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:12.587655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b675a2a-c0db-49ff-8f69-0d0454f30c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:12.589964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b675a2a-c0db-49ff-8f69-0d0454f30c9d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:12.599522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1321/2638] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:12.603909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659f63-2f77-4c84-af1c-2f99876e07f5 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:12.613967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659f63-2f77-4c84-af1c-2f99876e07f5 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:12.618791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d3aa7-e360-47d0-98f1-48359f757b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:12.619707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3aa7-e360-47d0-98f1-48359f757b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:12.620090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3aa7-e360-47d0-98f1-48359f757b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:12.620379 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3aa7-e360-47d0-98f1-48359f757b51 admin admin] PATH_INFO: `/v3/projects/5f77f707c05249f2b40bbf59ccb5f2db/users/1f8164a201ce4861938fbe9b0d14692f/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:12.622371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d3aa7-e360-47d0-98f1-48359f757b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f77f707c05249f2b40bbf59ccb5f2db, user_id=1f8164a201ce4861938fbe9b0d14692f, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:12.625055 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d3aa7-e360-47d0-98f1-48359f757b51 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:12.635650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1318/2639] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:12 2022] PUT /identity/v3/projects/5f77f707c05249f2b40bbf59ccb5f2db/users/1f8164a201ce4861938fbe9b0d14692f/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:13.525426 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b25e37-6e45-4bc2-8417-af747f20f079 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:13.525944 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b25e37-6e45-4bc2-8417-af747f20f079 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:13.526100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b25e37-6e45-4bc2-8417-af747f20f079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:13.551653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-13b25e37-6e45-4bc2-8417-af747f20f079 None None] MFA Rules not processed for user `1f8164a201ce4861938fbe9b0d14692f`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:13.552924 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-13b25e37-6e45-4bc2-8417-af747f20f079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:13.626452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1322/2640] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:13.637440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818a620-efec-48dc-af32-1c2248f9b2fd None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:13.637985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818a620-efec-48dc-af32-1c2248f9b2fd None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:13.638100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818a620-efec-48dc-af32-1c2248f9b2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:13.655483 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4818a620-efec-48dc-af32-1c2248f9b2fd None None] MFA Rules not processed for user `0918cc91d5874809857526485a8e73af`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:13.656720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4818a620-efec-48dc-af32-1c2248f9b2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:13.712958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1319/2641] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:13.726184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b25e37-6e45-4bc2-8417-af747f20f079 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:13.727936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-13b25e37-6e45-4bc2-8417-af747f20f079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:13.801692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b25e37-6e45-4bc2-8417-af747f20f079 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:13.807834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2d25-a2d1-48f3-8b87-478c2b840c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:13.808516 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2d25-a2d1-48f3-8b87-478c2b840c98 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:13.809048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2d25-a2d1-48f3-8b87-478c2b840c98 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:13.809342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a2d25-a2d1-48f3-8b87-478c2b840c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:13.817122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a2d25-a2d1-48f3-8b87-478c2b840c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:13.818960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a2d25-a2d1-48f3-8b87-478c2b840c98 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:13.828274 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1323/2642] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:14.051521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818a620-efec-48dc-af32-1c2248f9b2fd None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:14.052936 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4818a620-efec-48dc-af32-1c2248f9b2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:14.108710 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818a620-efec-48dc-af32-1c2248f9b2fd None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:14.112219 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2078-234c-4351-8f04-f2991a4afae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:14.112862 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2078-234c-4351-8f04-f2991a4afae2 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:14.113147 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2078-234c-4351-8f04-f2991a4afae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:14.113425 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2078-234c-4351-8f04-f2991a4afae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:14.115201 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-194a2078-234c-4351-8f04-f2991a4afae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:14.125298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a2078-234c-4351-8f04-f2991a4afae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:14.126749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a2078-234c-4351-8f04-f2991a4afae2 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:14.134590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1320/2643] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:23.824289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=91 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:24.131110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=67,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:26.749680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2d25-a2d1-48f3-8b87-478c2b840c98 service nova] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:26.751078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-618a2d25-a2d1-48f3-8b87-478c2b840c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:26.809313 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a2d25-a2d1-48f3-8b87-478c2b840c98 service nova] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:26.813057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d84f0-9bae-4f4d-934d-bbecc298a42f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:26.813706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d84f0-9bae-4f4d-934d-bbecc298a42f service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:26.813996 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d84f0-9bae-4f4d-934d-bbecc298a42f service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:26.814280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d84f0-9bae-4f4d-934d-bbecc298a42f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:26.823722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d84f0-9bae-4f4d-934d-bbecc298a42f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:26.825195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d84f0-9bae-4f4d-934d-bbecc298a42f service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:26.834841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1324/2644] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:35.577387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2078-234c-4351-8f04-f2991a4afae2 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:35.578866 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-194a2078-234c-4351-8f04-f2991a4afae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:35.589077 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2078-234c-4351-8f04-f2991a4afae2 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:35.592665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e7f00-76e3-4efc-b82a-eb5ebaf9343f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:35.593301 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7f00-76e3-4efc-b82a-eb5ebaf9343f service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:35.593587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7f00-76e3-4efc-b82a-eb5ebaf9343f service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:35.593867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e7f00-76e3-4efc-b82a-eb5ebaf9343f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:35.595523 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-059e7f00-76e3-4efc-b82a-eb5ebaf9343f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:35.657617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e7f00-76e3-4efc-b82a-eb5ebaf9343f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:35.659043 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e7f00-76e3-4efc-b82a-eb5ebaf9343f service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:35.669454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1321/2645] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:36.830503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=26 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:38.119757 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d84f0-9bae-4f4d-934d-bbecc298a42f service cinder] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:38.121314 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b00d84f0-9bae-4f4d-934d-bbecc298a42f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:38.135680 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d84f0-9bae-4f4d-934d-bbecc298a42f service cinder] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:38.140357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:38.141319 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:38.141674 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:38.142037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] PATH_INFO: `/v3/users/7c5973bf1342476880e749953c6518e3` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:38.143279 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c5973bf1342476880e749953c6518e3)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:38.145464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:38.192064 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c5973bf1342476880e749953c6518e3'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:38.193006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c5973bf1342476880e749953c6518e3'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:38.209041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c5973bf1342476880e749953c6518e3'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:38.209682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c5973bf1342476880e749953c6518e3'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:38.216978 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c5973bf1342476880e749953c6518e3'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:38.229068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1325/2646] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:38 2022] DELETE /identity/v3/users/7c5973bf1342476880e749953c6518e3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:38.234477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e9b0b-be01-453f-9101-7ade7acb15ad None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:38.234995 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e9b0b-be01-453f-9101-7ade7acb15ad None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:38.235426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e9b0b-be01-453f-9101-7ade7acb15ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:38.261299 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-6c7e9b0b-be01-453f-9101-7ade7acb15ad None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:38.262876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6c7e9b0b-be01-453f-9101-7ade7acb15ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:38.367549 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1322/2647] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:38.378672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:38.380514 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:38.457236 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad9c14-876b-48df-bdf6-7e9e7e431fbd admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:38.461332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca759c8-1463-4945-a237-d274917ee2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:38.462051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca759c8-1463-4945-a237-d274917ee2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:38.462362 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca759c8-1463-4945-a237-d274917ee2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:38.462616 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca759c8-1463-4945-a237-d274917ee2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:38.473764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca759c8-1463-4945-a237-d274917ee2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:38.475154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca759c8-1463-4945-a237-d274917ee2b1 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:38.485952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1326/2648] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:38.812365 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e9b0b-be01-453f-9101-7ade7acb15ad None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:38.813780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6c7e9b0b-be01-453f-9101-7ade7acb15ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:38.826998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e9b0b-be01-453f-9101-7ade7acb15ad None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:38.844396 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:38.846019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:38.846670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:38.846810 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] PATH_INFO: `/v3/projects/a930035c72fa488081809aa7f64e0e7f` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:38.848877 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a930035c72fa488081809aa7f64e0e7f)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:38.854619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:38.970662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a930035c72fa488081809aa7f64e0e7f', 'request_id': 'req-b8bf7880-2942-49da-adb0-a9f32f2dba3f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:38.983089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a930035c72fa488081809aa7f64e0e7f', 'request_id': 'req-b8bf7880-2942-49da-adb0-a9f32f2dba3f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:38.991587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a930035c72fa488081809aa7f64e0e7f', 'request_id': 'req-b8bf7880-2942-49da-adb0-a9f32f2dba3f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.012962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] The token cache is being invalidate because project a930035c72fa488081809aa7f64e0e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:39.013320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.014015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.016530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1323/2649] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:38 2022] DELETE /identity/v3/projects/a930035c72fa488081809aa7f64e0e7f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:39.020297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca759c8-1463-4945-a237-d274917ee2b1 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:39.034672 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:39.038433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:39.040913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca759c8-1463-4945-a237-d274917ee2b1 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:39.062804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:39.132598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf7880-2942-49da-adb0-a9f32f2dba3f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:39.138247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:39.138596 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:39.139159 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.139420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.139699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] PATH_INFO: `/v3/users/f8dd78b473fc4b2bbe3d85471419f594` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.139816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.140199 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.140503 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] PATH_INFO: `/v3/users/8958b5aa0cf14c0983e29cfe79927682` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.141143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8dd78b473fc4b2bbe3d85471419f594)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:39.142415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8958b5aa0cf14c0983e29cfe79927682)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:39.143109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:39.144789 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:39.167379 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:39.203380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8dd78b473fc4b2bbe3d85471419f594'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.205207 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8958b5aa0cf14c0983e29cfe79927682'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.206047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8958b5aa0cf14c0983e29cfe79927682'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.217155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8dd78b473fc4b2bbe3d85471419f594'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.217863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8dd78b473fc4b2bbe3d85471419f594'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.219241 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8958b5aa0cf14c0983e29cfe79927682'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.220093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8958b5aa0cf14c0983e29cfe79927682'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.228415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8958b5aa0cf14c0983e29cfe79927682'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.230368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8dd78b473fc4b2bbe3d85471419f594'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.238522 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8dd78b473fc4b2bbe3d85471419f594'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.241810 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1327/2650] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:39 2022] DELETE /identity/v3/users/8958b5aa0cf14c0983e29cfe79927682 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:39.246846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1324/2651] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:39 2022] DELETE /identity/v3/users/f8dd78b473fc4b2bbe3d85471419f594 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:39.463244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:39.464716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:39.536198 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c90ec-2157-4d8f-96e3-13e898740819 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:39.552165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:39.554846 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:39.609646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:39.610475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.610758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.611197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] PATH_INFO: `/v3/projects/82f885e8dea74a3a9ef30ea83b854609` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.612468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f885e8dea74a3a9ef30ea83b854609)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:39.614409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:39.630381 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa46b87-72ae-4f7d-9102-bca4f5399929 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:39.635831 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:39.636874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.637170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.637451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] PATH_INFO: `/v3/projects/d0c1ae1a7ff341c9a5240c7124eb627b` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.639091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c1ae1a7ff341c9a5240c7124eb627b)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:39.641042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:39.661956 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:39.666912 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f885e8dea74a3a9ef30ea83b854609', 'request_id': 'req-169f4546-20a8-4281-a334-2db625e2ecbd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.676130 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f885e8dea74a3a9ef30ea83b854609', 'request_id': 'req-169f4546-20a8-4281-a334-2db625e2ecbd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.684839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f885e8dea74a3a9ef30ea83b854609', 'request_id': 'req-169f4546-20a8-4281-a334-2db625e2ecbd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.685052 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:39.692845 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c1ae1a7ff341c9a5240c7124eb627b', 'request_id': 'req-28423886-e644-493f-be61-34f9e0f8cff2'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.697714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] The token cache is being invalidate because project 82f885e8dea74a3a9ef30ea83b854609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:39.698007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.698812 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-169f4546-20a8-4281-a334-2db625e2ecbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.700787 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1328/2652] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:39 2022] DELETE /identity/v3/projects/82f885e8dea74a3a9ef30ea83b854609 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:39.701547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c1ae1a7ff341c9a5240c7124eb627b', 'request_id': 'req-28423886-e644-493f-be61-34f9e0f8cff2'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.705621 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da7f75-0037-400e-9117-21cc066eed1a None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.705919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da7f75-0037-400e-9117-21cc066eed1a None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.706200 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da7f75-0037-400e-9117-21cc066eed1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.707683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c1ae1a7ff341c9a5240c7124eb627b', 'request_id': 'req-28423886-e644-493f-be61-34f9e0f8cff2'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.719412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] The token cache is being invalidate because project d0c1ae1a7ff341c9a5240c7124eb627b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:39.719700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.720434 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-28423886-e644-493f-be61-34f9e0f8cff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:39.721973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1325/2653] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:39 2022] DELETE /identity/v3/projects/d0c1ae1a7ff341c9a5240c7124eb627b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:39.727051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-64da7f75-0037-400e-9117-21cc066eed1a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:39.728167 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90066320-5d08-4678-a89d-6b8eb14b4b15 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.728457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90066320-5d08-4678-a89d-6b8eb14b4b15 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.728790 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90066320-5d08-4678-a89d-6b8eb14b4b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.728953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-64da7f75-0037-400e-9117-21cc066eed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:39.747685 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-90066320-5d08-4678-a89d-6b8eb14b4b15 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:39.748942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-90066320-5d08-4678-a89d-6b8eb14b4b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:39.788581 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1329/2654] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:39.796714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccad45-a69d-44e6-8934-e79558b2a526 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.797016 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccad45-a69d-44e6-8934-e79558b2a526 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.797460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccad45-a69d-44e6-8934-e79558b2a526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.809015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1326/2655] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:39.815292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-eaccad45-a69d-44e6-8934-e79558b2a526 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:39.816552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-eaccad45-a69d-44e6-8934-e79558b2a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:39.816717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a7ee3-e957-400c-8599-0e7a66a45bab None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.817064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a7ee3-e957-400c-8599-0e7a66a45bab None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.817600 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a7ee3-e957-400c-8599-0e7a66a45bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.824826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1330/2656] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:39.828728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccad45-a69d-44e6-8934-e79558b2a526 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:39.836179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d41a7ee3-e957-400c-8599-0e7a66a45bab None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:39.837889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d41a7ee3-e957-400c-8599-0e7a66a45bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:39.838168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccad45-a69d-44e6-8934-e79558b2a526 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:39.842906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd93d07-b138-4aed-afe6-6095aaa55744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:39.843559 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd93d07-b138-4aed-afe6-6095aaa55744 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.843853 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd93d07-b138-4aed-afe6-6095aaa55744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.844167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd93d07-b138-4aed-afe6-6095aaa55744 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.844897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd93d07-b138-4aed-afe6-6095aaa55744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:31:39.845219 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd93d07-b138-4aed-afe6-6095aaa55744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:39.845984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1327/2657] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:39.846816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd93d07-b138-4aed-afe6-6095aaa55744 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:39.850332 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a7ee3-e957-400c-8599-0e7a66a45bab None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:39.863640 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1331/2658] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:31:39.863797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a7ee3-e957-400c-8599-0e7a66a45bab None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:39.864980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd93d07-b138-4aed-afe6-6095aaa55744 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:39.865288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6d5d6-b8e2-4153-8f39-5f72298da4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:39.866020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d5d6-b8e2-4153-8f39-5f72298da4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.866308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d5d6-b8e2-4153-8f39-5f72298da4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.866585 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d5d6-b8e2-4153-8f39-5f72298da4d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.867338 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6d5d6-b8e2-4153-8f39-5f72298da4d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:31:39.867642 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6d5d6-b8e2-4153-8f39-5f72298da4d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:39.869316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6d5d6-b8e2-4153-8f39-5f72298da4d1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:39.874668 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd93d07-b138-4aed-afe6-6095aaa55744 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:39.879324 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e90e29-f10b-4f7a-bea0-a2290795b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:39.879991 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e90e29-f10b-4f7a-bea0-a2290795b100 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.880292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e90e29-f10b-4f7a-bea0-a2290795b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.880580 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e90e29-f10b-4f7a-bea0-a2290795b100 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.880958 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1328/2659] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:31:39.881296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e90e29-f10b-4f7a-bea0-a2290795b100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:39.883181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e90e29-f10b-4f7a-bea0-a2290795b100 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:39.885274 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6d5d6-b8e2-4153-8f39-5f72298da4d1 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:39.894774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6d5d6-b8e2-4153-8f39-5f72298da4d1 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:39.900486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d7bdf-a52a-485c-bbeb-7b703272bb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:39.901251 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d7bdf-a52a-485c-bbeb-7b703272bb93 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:39.901575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d7bdf-a52a-485c-bbeb-7b703272bb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:39.902251 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d7bdf-a52a-485c-bbeb-7b703272bb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:39.903072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d7bdf-a52a-485c-bbeb-7b703272bb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:39.905792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d7bdf-a52a-485c-bbeb-7b703272bb93 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:39.909813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1332/2660] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:39 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:31:39.913825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e90e29-f10b-4f7a-bea0-a2290795b100 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:39.939378 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1329/2661] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:39 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:31:39.943547 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d7bdf-a52a-485c-bbeb-7b703272bb93 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:39.983032 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e90e29-f10b-4f7a-bea0-a2290795b100 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.026135 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d7bdf-a52a-485c-bbeb-7b703272bb93 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.031250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc017-269c-445a-99de-7fcbd7f15ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.033240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc017-269c-445a-99de-7fcbd7f15ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.033602 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc017-269c-445a-99de-7fcbd7f15ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.033950 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc017-269c-445a-99de-7fcbd7f15ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.034720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bc017-269c-445a-99de-7fcbd7f15ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.036799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bc017-269c-445a-99de-7fcbd7f15ca7 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.043101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:40.065728 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1330/2662] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:39 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:31:40.071766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc017-269c-445a-99de-7fcbd7f15ca7 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.083882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc017-269c-445a-99de-7fcbd7f15ca7 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.087734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ecaca-fd62-4bb6-a3d6-ac5de35d8717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.088469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ecaca-fd62-4bb6-a3d6-ac5de35d8717 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.088756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ecaca-fd62-4bb6-a3d6-ac5de35d8717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.089029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ecaca-fd62-4bb6-a3d6-ac5de35d8717 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.089679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a75ac2-04ea-4c90-a9c2-8e059fb4c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.089806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ecaca-fd62-4bb6-a3d6-ac5de35d8717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.090452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a75ac2-04ea-4c90-a9c2-8e059fb4c39d admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.090799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a75ac2-04ea-4c90-a9c2-8e059fb4c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.091137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a75ac2-04ea-4c90-a9c2-8e059fb4c39d admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.091733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ecaca-fd62-4bb6-a3d6-ac5de35d8717 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.092093 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a75ac2-04ea-4c90-a9c2-8e059fb4c39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.093753 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a75ac2-04ea-4c90-a9c2-8e059fb4c39d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.104595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1331/2663] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:31:40.108791 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a75ac2-04ea-4c90-a9c2-8e059fb4c39d admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.115376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:40.120049 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1333/2664] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:39 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:31:40.120234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a75ac2-04ea-4c90-a9c2-8e059fb4c39d admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.122834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ecaca-fd62-4bb6-a3d6-ac5de35d8717 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.126849 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1144c-67b8-4592-a845-7ae01a585986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.127740 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1144c-67b8-4592-a845-7ae01a585986 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.128393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1144c-67b8-4592-a845-7ae01a585986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.128922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1144c-67b8-4592-a845-7ae01a585986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.129813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1144c-67b8-4592-a845-7ae01a585986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.132220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1144c-67b8-4592-a845-7ae01a585986 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.134660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ecaca-fd62-4bb6-a3d6-ac5de35d8717 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.140747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1b192-0cbb-4558-9cc9-449a14587a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.141598 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1b192-0cbb-4558-9cc9-449a14587a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.142006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1b192-0cbb-4558-9cc9-449a14587a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.142292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1b192-0cbb-4558-9cc9-449a14587a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.143080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1b192-0cbb-4558-9cc9-449a14587a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.145353 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1b192-0cbb-4558-9cc9-449a14587a2f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.145494 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1332/2665] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:40.149044 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1144c-67b8-4592-a845-7ae01a585986 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.159744 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1144c-67b8-4592-a845-7ae01a585986 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.163009 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1334/2666] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:31:40.164285 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1b192-0cbb-4558-9cc9-449a14587a2f admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.167647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b07c1-3765-4649-8122-3c87ef690167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.169094 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b07c1-3765-4649-8122-3c87ef690167 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.169387 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b07c1-3765-4649-8122-3c87ef690167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.169670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b07c1-3765-4649-8122-3c87ef690167 admin admin] PATH_INFO: `/v3/projects/460c564fc5344d94a00a37baafa5217c/users/0649522ed5a546c8a1d9e95ae065e5d5/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.173964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1b192-0cbb-4558-9cc9-449a14587a2f admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.178590 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4d6df-09b8-43ac-9d55-bcac635bc38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.179263 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4d6df-09b8-43ac-9d55-bcac635bc38c admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.179541 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4d6df-09b8-43ac-9d55-bcac635bc38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.179819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4d6df-09b8-43ac-9d55-bcac635bc38c admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.180606 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4d6df-09b8-43ac-9d55-bcac635bc38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.182195 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4d6df-09b8-43ac-9d55-bcac635bc38c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.187833 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b07c1-3765-4649-8122-3c87ef690167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460c564fc5344d94a00a37baafa5217c, user_id=0649522ed5a546c8a1d9e95ae065e5d5, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.191217 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b07c1-3765-4649-8122-3c87ef690167 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.196513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1335/2667] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:40.201067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4d6df-09b8-43ac-9d55-bcac635bc38c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.207107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1333/2668] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:40 2022] PUT /identity/v3/projects/460c564fc5344d94a00a37baafa5217c/users/0649522ed5a546c8a1d9e95ae065e5d5/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:40.215983 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4d6df-09b8-43ac-9d55-bcac635bc38c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.219067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f96317-16a5-4775-a073-f02ec6f7ee0a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.219366 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f96317-16a5-4775-a073-f02ec6f7ee0a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.219645 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f96317-16a5-4775-a073-f02ec6f7ee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.247380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-f8f96317-16a5-4775-a073-f02ec6f7ee0a None None] MFA Rules not processed for user `0649522ed5a546c8a1d9e95ae065e5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:40.248729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f8f96317-16a5-4775-a073-f02ec6f7ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:40.279566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c2066-7400-44ae-964d-bb7374fce72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.280848 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2066-7400-44ae-964d-bb7374fce72f admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.281120 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2066-7400-44ae-964d-bb7374fce72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.281408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2066-7400-44ae-964d-bb7374fce72f admin admin] PATH_INFO: `/v3/projects/b4b99045e633458aa43ae9d744154662/users/ea4596de523d4f08ab2b2e7b2eb0720d/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.302756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c2066-7400-44ae-964d-bb7374fce72f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b99045e633458aa43ae9d744154662, user_id=ea4596de523d4f08ab2b2e7b2eb0720d, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.307620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c2066-7400-44ae-964d-bb7374fce72f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.324876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1334/2669] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:40.326234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1336/2670] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:40 2022] PUT /identity/v3/projects/b4b99045e633458aa43ae9d744154662/users/ea4596de523d4f08ab2b2e7b2eb0720d/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:40.329481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f96317-16a5-4775-a073-f02ec6f7ee0a None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.341040 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915ab6c-719f-4fc8-beab-233dc2df8632 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.341346 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915ab6c-719f-4fc8-beab-233dc2df8632 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.341976 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f96317-16a5-4775-a073-f02ec6f7ee0a None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.342671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915ab6c-719f-4fc8-beab-233dc2df8632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.375762 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-a915ab6c-719f-4fc8-beab-233dc2df8632 None None] MFA Rules not processed for user `ea4596de523d4f08ab2b2e7b2eb0720d`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:40.377042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-a915ab6c-719f-4fc8-beab-233dc2df8632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:40.417433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c2339-d850-400c-8293-2d80bc476026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.418156 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2339-d850-400c-8293-2d80bc476026 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.418446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2339-d850-400c-8293-2d80bc476026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.418730 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c2339-d850-400c-8293-2d80bc476026 admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.419427 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c2339-d850-400c-8293-2d80bc476026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.421445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c2339-d850-400c-8293-2d80bc476026 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.449337 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1335/2671] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:40 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:31:40.449861 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1337/2672] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:40.454706 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915ab6c-719f-4fc8-beab-233dc2df8632 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.460928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c2339-d850-400c-8293-2d80bc476026 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.463288 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3b3c2339-d850-400c-8293-2d80bc476026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:40.465609 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915ab6c-719f-4fc8-beab-233dc2df8632 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.478466 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:40.511264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:40.526755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd7515-bb74-4cb7-899e-f012236d9782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.527438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd7515-bb74-4cb7-899e-f012236d9782 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.527758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd7515-bb74-4cb7-899e-f012236d9782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.528075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd7515-bb74-4cb7-899e-f012236d9782 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.528776 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd7515-bb74-4cb7-899e-f012236d9782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.530694 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd7515-bb74-4cb7-899e-f012236d9782 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.539106 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c2339-d850-400c-8293-2d80bc476026 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.545391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b75d1a-1372-40f3-b4a3-34fc6a5b9207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.546040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b75d1a-1372-40f3-b4a3-34fc6a5b9207 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.546322 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b75d1a-1372-40f3-b4a3-34fc6a5b9207 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.546597 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b75d1a-1372-40f3-b4a3-34fc6a5b9207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.553375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1338/2673] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:40 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:40.554406 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd7515-bb74-4cb7-899e-f012236d9782 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.564360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd7515-bb74-4cb7-899e-f012236d9782 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.569293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c5f95-917a-40e3-9ddf-2215430a2d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.569937 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5f95-917a-40e3-9ddf-2215430a2d55 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.570222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5f95-917a-40e3-9ddf-2215430a2d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.570502 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c5f95-917a-40e3-9ddf-2215430a2d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.571788 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c5f95-917a-40e3-9ddf-2215430a2d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.573439 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c5f95-917a-40e3-9ddf-2215430a2d55 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.587727 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1339/2674] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:40.591872 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c5f95-917a-40e3-9ddf-2215430a2d55 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.601958 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c5f95-917a-40e3-9ddf-2215430a2d55 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.606816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516b6d3-38d8-48db-bd61-fa55c1019e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.607417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b75d1a-1372-40f3-b4a3-34fc6a5b9207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.607719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516b6d3-38d8-48db-bd61-fa55c1019e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.607993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516b6d3-38d8-48db-bd61-fa55c1019e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.608300 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516b6d3-38d8-48db-bd61-fa55c1019e9c admin admin] PATH_INFO: `/v3/projects/02fe987d37694df5aa3f428153250517/users/047da4df57974f3f9257d5f4c3b5fc10/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.609172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b75d1a-1372-40f3-b4a3-34fc6a5b9207 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.618673 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1336/2675] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:31:40.624022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516b6d3-38d8-48db-bd61-fa55c1019e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fe987d37694df5aa3f428153250517, user_id=047da4df57974f3f9257d5f4c3b5fc10, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.626558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516b6d3-38d8-48db-bd61-fa55c1019e9c admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.640544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1340/2676] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:40 2022] PUT /identity/v3/projects/02fe987d37694df5aa3f428153250517/users/047da4df57974f3f9257d5f4c3b5fc10/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:40.644893 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b75d1a-1372-40f3-b4a3-34fc6a5b9207 service nova] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.656129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b75d1a-1372-40f3-b4a3-34fc6a5b9207 service nova] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.713341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96d435-633a-4044-8114-593d49658a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.714018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96d435-633a-4044-8114-593d49658a2a admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.714307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96d435-633a-4044-8114-593d49658a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.714699 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96d435-633a-4044-8114-593d49658a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.715435 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96d435-633a-4044-8114-593d49658a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.717089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96d435-633a-4044-8114-593d49658a2a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.726804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1337/2677] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:40.731889 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516b6d3-38d8-48db-bd61-fa55c1019e9c admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.742629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516b6d3-38d8-48db-bd61-fa55c1019e9c admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.747825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd693d-8ae2-4f39-aa62-12859ed26a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.748902 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd693d-8ae2-4f39-aa62-12859ed26a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.749192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd693d-8ae2-4f39-aa62-12859ed26a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.749490 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd693d-8ae2-4f39-aa62-12859ed26a46 admin admin] PATH_INFO: `/v3/projects/02fe987d37694df5aa3f428153250517/users/047da4df57974f3f9257d5f4c3b5fc10/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.751451 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd693d-8ae2-4f39-aa62-12859ed26a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fe987d37694df5aa3f428153250517, user_id=047da4df57974f3f9257d5f4c3b5fc10, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.754211 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd693d-8ae2-4f39-aa62-12859ed26a46 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:40.764612 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1341/2678] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:40 2022] PUT /identity/v3/projects/02fe987d37694df5aa3f428153250517/users/047da4df57974f3f9257d5f4c3b5fc10/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:40.776768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dca44-8bf1-4712-822d-1e82fce53079 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.777060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dca44-8bf1-4712-822d-1e82fce53079 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.777340 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dca44-8bf1-4712-822d-1e82fce53079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.804518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-d41dca44-8bf1-4712-822d-1e82fce53079 None None] MFA Rules not processed for user `047da4df57974f3f9257d5f4c3b5fc10`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:40.805768 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-d41dca44-8bf1-4712-822d-1e82fce53079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:40.879263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1338/2679] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:40.891371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd693d-8ae2-4f39-aa62-12859ed26a46 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:40.893454 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b8bd693d-8ae2-4f39-aa62-12859ed26a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:40.971942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd693d-8ae2-4f39-aa62-12859ed26a46 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:40.977673 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcdd35-4223-4773-8248-881e88a78f7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:40.978344 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcdd35-4223-4773-8248-881e88a78f7a service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:40.978637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcdd35-4223-4773-8248-881e88a78f7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:40.978923 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcdd35-4223-4773-8248-881e88a78f7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:40.990012 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcdd35-4223-4773-8248-881e88a78f7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:40.991650 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcdd35-4223-4773-8248-881e88a78f7a service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:41.001467 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1342/2680] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:41.030468 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dca44-8bf1-4712-822d-1e82fce53079 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:41.034777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:41.095325 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dca44-8bf1-4712-822d-1e82fce53079 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:41.099881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:41.100780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:41.101069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:41.101351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] PATH_INFO: `/v3/users/0649522ed5a546c8a1d9e95ae065e5d5` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:41.102745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0649522ed5a546c8a1d9e95ae065e5d5)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:41.104703 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:41.150141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0649522ed5a546c8a1d9e95ae065e5d5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.161709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0649522ed5a546c8a1d9e95ae065e5d5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.162386 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0649522ed5a546c8a1d9e95ae065e5d5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.168916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0649522ed5a546c8a1d9e95ae065e5d5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.175746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0649522ed5a546c8a1d9e95ae065e5d5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.182281 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1339/2681] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:41 2022] DELETE /identity/v3/users/0649522ed5a546c8a1d9e95ae065e5d5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:41.187006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77835ba-6f59-4b5b-81ec-b69dc6a0dfa7 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:41.187499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77835ba-6f59-4b5b-81ec-b69dc6a0dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:41.187629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77835ba-6f59-4b5b-81ec-b69dc6a0dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:41.206440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-d77835ba-6f59-4b5b-81ec-b69dc6a0dfa7 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:41.207734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d77835ba-6f59-4b5b-81ec-b69dc6a0dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:41.266642 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1343/2682] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:41.276254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:41.277660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:41.333301 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c517c-d916-4413-bc9a-1576d6b13f8b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:41.336967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b2166-d035-4eaa-8602-500d33b9ffae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:41.337603 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2166-d035-4eaa-8602-500d33b9ffae service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:41.337885 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2166-d035-4eaa-8602-500d33b9ffae service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:41.338162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b2166-d035-4eaa-8602-500d33b9ffae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:41.346927 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b2166-d035-4eaa-8602-500d33b9ffae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:41.348395 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b2166-d035-4eaa-8602-500d33b9ffae service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:41.357647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1340/2683] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:31:41.643222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77835ba-6f59-4b5b-81ec-b69dc6a0dfa7 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:41.645576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d77835ba-6f59-4b5b-81ec-b69dc6a0dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:41.657995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:41.665566 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77835ba-6f59-4b5b-81ec-b69dc6a0dfa7 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:41.672192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:41.673201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:41.673504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:41.673796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] PATH_INFO: `/v3/projects/460c564fc5344d94a00a37baafa5217c` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:41.674981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460c564fc5344d94a00a37baafa5217c)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:41.677025 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:41.723192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460c564fc5344d94a00a37baafa5217c', 'request_id': 'req-c9076b31-c8db-4224-a20f-6c3b99f8fa80'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.730366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460c564fc5344d94a00a37baafa5217c', 'request_id': 'req-c9076b31-c8db-4224-a20f-6c3b99f8fa80'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.736535 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460c564fc5344d94a00a37baafa5217c', 'request_id': 'req-c9076b31-c8db-4224-a20f-6c3b99f8fa80'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.748892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] The token cache is being invalidate because project 460c564fc5344d94a00a37baafa5217c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:41.749189 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.749836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.751378 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1344/2684] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:41 2022] DELETE /identity/v3/projects/460c564fc5344d94a00a37baafa5217c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:41.755621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b2166-d035-4eaa-8602-500d33b9ffae service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:41.765286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b2166-d035-4eaa-8602-500d33b9ffae service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:41.785718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:41.827351 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e013c-cc29-4fa4-9812-533a6f065c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:41.828346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e013c-cc29-4fa4-9812-533a6f065c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:41.828633 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e013c-cc29-4fa4-9812-533a6f065c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:41.828913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e013c-cc29-4fa4-9812-533a6f065c49 admin admin] PATH_INFO: `/v3/users/047da4df57974f3f9257d5f4c3b5fc10` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:41.830099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e013c-cc29-4fa4-9812-533a6f065c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=047da4df57974f3f9257d5f4c3b5fc10)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:41.832634 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e013c-cc29-4fa4-9812-533a6f065c49 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:41.882328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c49e013c-cc29-4fa4-9812-533a6f065c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047da4df57974f3f9257d5f4c3b5fc10'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.893772 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c49e013c-cc29-4fa4-9812-533a6f065c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047da4df57974f3f9257d5f4c3b5fc10'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.894422 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c49e013c-cc29-4fa4-9812-533a6f065c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047da4df57974f3f9257d5f4c3b5fc10'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.901839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c49e013c-cc29-4fa4-9812-533a6f065c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047da4df57974f3f9257d5f4c3b5fc10'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.908770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c49e013c-cc29-4fa4-9812-533a6f065c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047da4df57974f3f9257d5f4c3b5fc10'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:41.914449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1341/2685] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:41 2022] DELETE /identity/v3/users/047da4df57974f3f9257d5f4c3b5fc10 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:42.201139 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:42.203663 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:42.220077 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9076b31-c8db-4224-a20f-6c3b99f8fa80 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:42.296144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:42.297053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:42.297357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:42.297628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] PATH_INFO: `/v3/projects/02fe987d37694df5aa3f428153250517` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:42.298839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02fe987d37694df5aa3f428153250517)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:42.300820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:42.356163 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02fe987d37694df5aa3f428153250517', 'request_id': 'req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:42.363897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02fe987d37694df5aa3f428153250517', 'request_id': 'req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:42.370788 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02fe987d37694df5aa3f428153250517', 'request_id': 'req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:42.382427 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] The token cache is being invalidate because project 02fe987d37694df5aa3f428153250517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:42.383328 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:42.384106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-d55d13c7-9f17-4c7c-8e61-c387cc2cfa69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:42.385637 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1345/2686] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:42 2022] DELETE /identity/v3/projects/02fe987d37694df5aa3f428153250517 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:42.390627 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e8558-26d8-4485-8986-66676ec349b5 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:42.391101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e8558-26d8-4485-8986-66676ec349b5 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:42.391228 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e8558-26d8-4485-8986-66676ec349b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:42.410428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-a51e8558-26d8-4485-8986-66676ec349b5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:42.411648 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a51e8558-26d8-4485-8986-66676ec349b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:42.469936 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1342/2687] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:42.478176 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d1f2-3864-4e88-8d0d-6ac65409c00d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:42.478469 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d1f2-3864-4e88-8d0d-6ac65409c00d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:42.478750 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996d1f2-3864-4e88-8d0d-6ac65409c00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:42.497149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-8996d1f2-3864-4e88-8d0d-6ac65409c00d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:42.498332 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-8996d1f2-3864-4e88-8d0d-6ac65409c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:42.506125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1346/2688] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:42.510231 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e8558-26d8-4485-8986-66676ec349b5 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:42.519624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e8558-26d8-4485-8986-66676ec349b5 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:42.524121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173837d-40c3-4589-a501-d47742dafc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:42.524769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173837d-40c3-4589-a501-d47742dafc86 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:42.525056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173837d-40c3-4589-a501-d47742dafc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:42.525329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173837d-40c3-4589-a501-d47742dafc86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:42.526039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173837d-40c3-4589-a501-d47742dafc86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:31:42.526344 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173837d-40c3-4589-a501-d47742dafc86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:42.527922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173837d-40c3-4589-a501-d47742dafc86 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:42.539179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1343/2689] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:31:42.543742 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996d1f2-3864-4e88-8d0d-6ac65409c00d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:42.552909 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996d1f2-3864-4e88-8d0d-6ac65409c00d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:42.558173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae1f6f-eb39-4e3b-8cb4-852cb0774067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:42.558824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae1f6f-eb39-4e3b-8cb4-852cb0774067 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:42.559109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae1f6f-eb39-4e3b-8cb4-852cb0774067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:42.559387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae1f6f-eb39-4e3b-8cb4-852cb0774067 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:42.560117 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae1f6f-eb39-4e3b-8cb4-852cb0774067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:42.562002 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae1f6f-eb39-4e3b-8cb4-852cb0774067 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:42.565938 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:42.592444 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1347/2690] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:42 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:42.596610 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173837d-40c3-4589-a501-d47742dafc86 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:42.607096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173837d-40c3-4589-a501-d47742dafc86 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:42.636297 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:42.666648 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625890cf-18b0-4a62-88b3-fc879aece772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:42.667320 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625890cf-18b0-4a62-88b3-fc879aece772 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:42.667607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625890cf-18b0-4a62-88b3-fc879aece772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:42.667887 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625890cf-18b0-4a62-88b3-fc879aece772 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:42.668797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625890cf-18b0-4a62-88b3-fc879aece772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:42.670721 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625890cf-18b0-4a62-88b3-fc879aece772 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:42.695751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1344/2691] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:42 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:42.697187 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae1f6f-eb39-4e3b-8cb4-852cb0774067 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:42.707866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae1f6f-eb39-4e3b-8cb4-852cb0774067 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:42.721151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ccdfb-c8e8-4fdd-a8f8-35af6237aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:42.721993 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ccdfb-c8e8-4fdd-a8f8-35af6237aa2a admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:42.722347 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ccdfb-c8e8-4fdd-a8f8-35af6237aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:42.722695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ccdfb-c8e8-4fdd-a8f8-35af6237aa2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:42.723508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ccdfb-c8e8-4fdd-a8f8-35af6237aa2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:42.725509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ccdfb-c8e8-4fdd-a8f8-35af6237aa2a admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:42.736823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1348/2692] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:42.741057 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625890cf-18b0-4a62-88b3-fc879aece772 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:42.751308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625890cf-18b0-4a62-88b3-fc879aece772 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:42.757078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372a888-abed-4198-8d0e-0cd041b05c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:42.757815 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372a888-abed-4198-8d0e-0cd041b05c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:42.758108 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372a888-abed-4198-8d0e-0cd041b05c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:42.758392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372a888-abed-4198-8d0e-0cd041b05c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:42.759229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372a888-abed-4198-8d0e-0cd041b05c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:42.760875 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372a888-abed-4198-8d0e-0cd041b05c6b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:42.773409 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1345/2693] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:42.778208 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ccdfb-c8e8-4fdd-a8f8-35af6237aa2a admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:42.788459 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ccdfb-c8e8-4fdd-a8f8-35af6237aa2a admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:42.793891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d831428-bffe-4eff-9fa7-399d75bef733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:42.794812 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d831428-bffe-4eff-9fa7-399d75bef733 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:42.795128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d831428-bffe-4eff-9fa7-399d75bef733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:42.795420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d831428-bffe-4eff-9fa7-399d75bef733 admin admin] PATH_INFO: `/v3/projects/e5ff1b6d24244f779387cebfd852c5cf/users/1e9db9b792954dcba8db718c29923dda/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:42.810433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d831428-bffe-4eff-9fa7-399d75bef733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ff1b6d24244f779387cebfd852c5cf, user_id=1e9db9b792954dcba8db718c29923dda, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:42.813099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d831428-bffe-4eff-9fa7-399d75bef733 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:42.826305 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1349/2694] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:42 2022] PUT /identity/v3/projects/e5ff1b6d24244f779387cebfd852c5cf/users/1e9db9b792954dcba8db718c29923dda/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:42.839568 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93609158-1b8c-489c-94b3-1a6a95a6c932 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:42.839886 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93609158-1b8c-489c-94b3-1a6a95a6c932 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:42.840191 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93609158-1b8c-489c-94b3-1a6a95a6c932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:42.867638 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-93609158-1b8c-489c-94b3-1a6a95a6c932 None None] MFA Rules not processed for user `1e9db9b792954dcba8db718c29923dda`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:42.869039 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-93609158-1b8c-489c-94b3-1a6a95a6c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:42.951889 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1346/2695] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:42.956371 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d831428-bffe-4eff-9fa7-399d75bef733 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:43.023509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d831428-bffe-4eff-9fa7-399d75bef733 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:43.028676 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05db6d-4b88-4d9e-b7c2-811ccc8fe2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:43.029369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05db6d-4b88-4d9e-b7c2-811ccc8fe2fb admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:43.029655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05db6d-4b88-4d9e-b7c2-811ccc8fe2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:43.029932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05db6d-4b88-4d9e-b7c2-811ccc8fe2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:43.030630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05db6d-4b88-4d9e-b7c2-811ccc8fe2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:43.032562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05db6d-4b88-4d9e-b7c2-811ccc8fe2fb admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:43.058732 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1350/2696] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:42 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:43.062814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93609158-1b8c-489c-94b3-1a6a95a6c932 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:43.074349 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93609158-1b8c-489c-94b3-1a6a95a6c932 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:43.128662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec3c81-6092-4769-842a-6e97b4124952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:43.129329 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec3c81-6092-4769-842a-6e97b4124952 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:43.129617 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec3c81-6092-4769-842a-6e97b4124952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:43.129897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec3c81-6092-4769-842a-6e97b4124952 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:43.130588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec3c81-6092-4769-842a-6e97b4124952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:43.132526 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec3c81-6092-4769-842a-6e97b4124952 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:43.153563 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1347/2697] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:43 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:43.157441 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05db6d-4b88-4d9e-b7c2-811ccc8fe2fb admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:43.168172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05db6d-4b88-4d9e-b7c2-811ccc8fe2fb admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:43.172949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0692ff-37ed-4165-8a8f-795a1c5edcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:43.173626 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0692ff-37ed-4165-8a8f-795a1c5edcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:43.173915 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0692ff-37ed-4165-8a8f-795a1c5edcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:43.174196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0692ff-37ed-4165-8a8f-795a1c5edcf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:43.174920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0692ff-37ed-4165-8a8f-795a1c5edcf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:43.176547 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0692ff-37ed-4165-8a8f-795a1c5edcf5 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:43.188483 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1351/2698] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:43.192876 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec3c81-6092-4769-842a-6e97b4124952 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:43.203109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec3c81-6092-4769-842a-6e97b4124952 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:43.207679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c067e5d-878f-4a88-b91b-a91d4dfec248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:43.208586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c067e5d-878f-4a88-b91b-a91d4dfec248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:43.208912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c067e5d-878f-4a88-b91b-a91d4dfec248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:43.209146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c067e5d-878f-4a88-b91b-a91d4dfec248 admin admin] PATH_INFO: `/v3/projects/56ee4863e9a04fad8da2f23843502c6e/users/322c0bea49ca4dc3a95dc4345ae0e1d4/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:43.223476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c067e5d-878f-4a88-b91b-a91d4dfec248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ee4863e9a04fad8da2f23843502c6e, user_id=322c0bea49ca4dc3a95dc4345ae0e1d4, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:43.226128 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c067e5d-878f-4a88-b91b-a91d4dfec248 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:43.238819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1348/2699] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:43 2022] PUT /identity/v3/projects/56ee4863e9a04fad8da2f23843502c6e/users/322c0bea49ca4dc3a95dc4345ae0e1d4/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:43.242628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0692ff-37ed-4165-8a8f-795a1c5edcf5 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:43.253247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0692ff-37ed-4165-8a8f-795a1c5edcf5 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:43.308151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe62b6-54bb-4c77-a9b7-f9c6f762149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:43.308828 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe62b6-54bb-4c77-a9b7-f9c6f762149b admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:43.309099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe62b6-54bb-4c77-a9b7-f9c6f762149b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:43.309375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe62b6-54bb-4c77-a9b7-f9c6f762149b admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:43.310093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe62b6-54bb-4c77-a9b7-f9c6f762149b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:43.311682 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe62b6-54bb-4c77-a9b7-f9c6f762149b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:43.321734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1352/2700] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:43.325759 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c067e5d-878f-4a88-b91b-a91d4dfec248 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:43.332318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:43.336075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c067e5d-878f-4a88-b91b-a91d4dfec248 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:43.341762 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389d4cc-ffbe-4108-bf50-15152898983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:43.342642 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389d4cc-ffbe-4108-bf50-15152898983c admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:43.342928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389d4cc-ffbe-4108-bf50-15152898983c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:43.343207 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389d4cc-ffbe-4108-bf50-15152898983c admin admin] PATH_INFO: `/v3/projects/56ee4863e9a04fad8da2f23843502c6e/users/322c0bea49ca4dc3a95dc4345ae0e1d4/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:43.345183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389d4cc-ffbe-4108-bf50-15152898983c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ee4863e9a04fad8da2f23843502c6e, user_id=322c0bea49ca4dc3a95dc4345ae0e1d4, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:43.347808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389d4cc-ffbe-4108-bf50-15152898983c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:43.358439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1349/2701] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:43 2022] PUT /identity/v3/projects/56ee4863e9a04fad8da2f23843502c6e/users/322c0bea49ca4dc3a95dc4345ae0e1d4/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:43.368980 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db4b86-4154-4764-bfa9-9e15e14fa2cc None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:43.369276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db4b86-4154-4764-bfa9-9e15e14fa2cc None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:43.369558 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db4b86-4154-4764-bfa9-9e15e14fa2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:43.395468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-35db4b86-4154-4764-bfa9-9e15e14fa2cc None None] MFA Rules not processed for user `322c0bea49ca4dc3a95dc4345ae0e1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:43.396910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-35db4b86-4154-4764-bfa9-9e15e14fa2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:43.406229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:43.476903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1353/2702] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:43.488290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389d4cc-ffbe-4108-bf50-15152898983c admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:43.490121 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-e389d4cc-ffbe-4108-bf50-15152898983c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:43.550593 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389d4cc-ffbe-4108-bf50-15152898983c admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:43.554220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c6f78-33f6-4304-9e82-61da3063b84e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:43.554851 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c6f78-33f6-4304-9e82-61da3063b84e service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:43.555132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c6f78-33f6-4304-9e82-61da3063b84e service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:43.555439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c6f78-33f6-4304-9e82-61da3063b84e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:43.564350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c6f78-33f6-4304-9e82-61da3063b84e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:43.565773 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c6f78-33f6-4304-9e82-61da3063b84e service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:43.575199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1350/2703] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:43.645331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db4b86-4154-4764-bfa9-9e15e14fa2cc None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:43.655465 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db4b86-4154-4764-bfa9-9e15e14fa2cc None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:43.659005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d42231-41fb-426d-973d-277575685e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:43.659644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42231-41fb-426d-973d-277575685e96 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:43.659929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42231-41fb-426d-973d-277575685e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:43.660236 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42231-41fb-426d-973d-277575685e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:43.723270 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d42231-41fb-426d-973d-277575685e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:43.724738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d42231-41fb-426d-973d-277575685e96 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:43.734240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1354/2704] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:45.808718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c6f78-33f6-4304-9e82-61da3063b84e service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:45.809153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c19c6f78-33f6-4304-9e82-61da3063b84e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:45.876258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c6f78-33f6-4304-9e82-61da3063b84e service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:45.881103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:45.882000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:45.882313 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:45.882560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] PATH_INFO: `/v3/users/ea4596de523d4f08ab2b2e7b2eb0720d` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:45.884546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4596de523d4f08ab2b2e7b2eb0720d)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:45.886473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:45.931362 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4596de523d4f08ab2b2e7b2eb0720d'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:45.944477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4596de523d4f08ab2b2e7b2eb0720d'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:45.945172 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4596de523d4f08ab2b2e7b2eb0720d'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:45.952707 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4596de523d4f08ab2b2e7b2eb0720d'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:45.959485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4596de523d4f08ab2b2e7b2eb0720d'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:45.965363 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1351/2705] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:45 2022] DELETE /identity/v3/users/ea4596de523d4f08ab2b2e7b2eb0720d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:45.969777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f5f3c-175b-4ac9-b266-b510e9a6cb2d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:45.970229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f5f3c-175b-4ac9-b266-b510e9a6cb2d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:45.970349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f5f3c-175b-4ac9-b266-b510e9a6cb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:45.986821 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-be0f5f3c-175b-4ac9-b266-b510e9a6cb2d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:45.988036 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-be0f5f3c-175b-4ac9-b266-b510e9a6cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:46.048843 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1355/2706] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:46.058929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:46.060333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:46.075333 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:46.119420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1402fd3-f1e1-4de0-9847-6240654ba3be admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:46.123198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1413fff-7561-4de4-b066-78747eaec554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:46.123853 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1413fff-7561-4de4-b066-78747eaec554 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:46.124168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1413fff-7561-4de4-b066-78747eaec554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:46.124449 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1413fff-7561-4de4-b066-78747eaec554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:46.133508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1413fff-7561-4de4-b066-78747eaec554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:46.134936 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1413fff-7561-4de4-b066-78747eaec554 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:46.144411 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1352/2707] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:46.406041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f5f3c-175b-4ac9-b266-b510e9a6cb2d None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:46.407758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-be0f5f3c-175b-4ac9-b266-b510e9a6cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:46.421620 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f5f3c-175b-4ac9-b266-b510e9a6cb2d None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:46.426874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:46.427741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:46.428055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:46.428335 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] PATH_INFO: `/v3/projects/b4b99045e633458aa43ae9d744154662` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:46.429523 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b99045e633458aa43ae9d744154662)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:46.432114 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:46.478447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:46.485714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b99045e633458aa43ae9d744154662', 'request_id': 'req-9224f58c-6520-4cc3-8930-9bba3fe03a57'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:46.499377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b99045e633458aa43ae9d744154662', 'request_id': 'req-9224f58c-6520-4cc3-8930-9bba3fe03a57'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:46.499377 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b99045e633458aa43ae9d744154662', 'request_id': 'req-9224f58c-6520-4cc3-8930-9bba3fe03a57'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:46.510084 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] The token cache is being invalidate because project b4b99045e633458aa43ae9d744154662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:46.510374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:46.511027 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-9224f58c-6520-4cc3-8930-9bba3fe03a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:46.512839 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1356/2708] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:46 2022] DELETE /identity/v3/projects/b4b99045e633458aa43ae9d744154662 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:46.518659 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031853d-6ff4-41eb-996c-1d30438d7b35 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:46.519022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031853d-6ff4-41eb-996c-1d30438d7b35 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:46.519370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031853d-6ff4-41eb-996c-1d30438d7b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:46.537750 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-2031853d-6ff4-41eb-996c-1d30438d7b35 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:46.539450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2031853d-6ff4-41eb-996c-1d30438d7b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:46.606286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1353/2709] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:46.613982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d59b65-fa19-4c25-a68f-7c2a36913788 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:46.614275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d59b65-fa19-4c25-a68f-7c2a36913788 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:46.614585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d59b65-fa19-4c25-a68f-7c2a36913788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:46.632707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c2d59b65-fa19-4c25-a68f-7c2a36913788 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:46.633994 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c2d59b65-fa19-4c25-a68f-7c2a36913788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:46.642277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1357/2710] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:46.646702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031853d-6ff4-41eb-996c-1d30438d7b35 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:46.657119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031853d-6ff4-41eb-996c-1d30438d7b35 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:46.661795 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11bc16-acac-4d89-9c73-4d8ce5a99a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:46.662453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11bc16-acac-4d89-9c73-4d8ce5a99a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:46.662741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11bc16-acac-4d89-9c73-4d8ce5a99a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:46.663031 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11bc16-acac-4d89-9c73-4d8ce5a99a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:46.663802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11bc16-acac-4d89-9c73-4d8ce5a99a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:31:46.664124 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11bc16-acac-4d89-9c73-4d8ce5a99a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:46.666370 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11bc16-acac-4d89-9c73-4d8ce5a99a9a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:46.677967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1354/2711] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:31:46.682179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d59b65-fa19-4c25-a68f-7c2a36913788 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:46.692238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d59b65-fa19-4c25-a68f-7c2a36913788 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:46.697107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb264f1-e77d-4ce0-99c1-0f23bddbdf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:46.697845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb264f1-e77d-4ce0-99c1-0f23bddbdf4e admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:46.698132 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb264f1-e77d-4ce0-99c1-0f23bddbdf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:46.698412 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb264f1-e77d-4ce0-99c1-0f23bddbdf4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:46.699097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb264f1-e77d-4ce0-99c1-0f23bddbdf4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:46.701201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb264f1-e77d-4ce0-99c1-0f23bddbdf4e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:46.727729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1358/2712] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:46 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:46.731922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11bc16-acac-4d89-9c73-4d8ce5a99a9a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:46.742959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11bc16-acac-4d89-9c73-4d8ce5a99a9a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:46.803287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e2857-9851-4bd6-a3a0-22b67d8fa43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:46.804005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2857-9851-4bd6-a3a0-22b67d8fa43f admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:46.804298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2857-9851-4bd6-a3a0-22b67d8fa43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:46.804578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2857-9851-4bd6-a3a0-22b67d8fa43f admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:46.805306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e2857-9851-4bd6-a3a0-22b67d8fa43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:46.807244 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e2857-9851-4bd6-a3a0-22b67d8fa43f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:46.827697 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1355/2713] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:46 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:46.831920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb264f1-e77d-4ce0-99c1-0f23bddbdf4e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:46.843164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb264f1-e77d-4ce0-99c1-0f23bddbdf4e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:46.848067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ad9b1-380a-46fe-a2aa-ecc4b10b4ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:46.849111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ad9b1-380a-46fe-a2aa-ecc4b10b4ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:46.849111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ad9b1-380a-46fe-a2aa-ecc4b10b4ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:46.849361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ad9b1-380a-46fe-a2aa-ecc4b10b4ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:46.850086 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ad9b1-380a-46fe-a2aa-ecc4b10b4ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:46.851697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ad9b1-380a-46fe-a2aa-ecc4b10b4ce7 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:46.863043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1359/2714] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:46.867081 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e2857-9851-4bd6-a3a0-22b67d8fa43f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:46.877465 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e2857-9851-4bd6-a3a0-22b67d8fa43f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:46.882159 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2ca98-1dd7-4bcb-88fa-9aeac3928921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:46.882847 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ca98-1dd7-4bcb-88fa-9aeac3928921 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:46.883133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ca98-1dd7-4bcb-88fa-9aeac3928921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:46.883929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ca98-1dd7-4bcb-88fa-9aeac3928921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:46.884671 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2ca98-1dd7-4bcb-88fa-9aeac3928921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:46.886245 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2ca98-1dd7-4bcb-88fa-9aeac3928921 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:46.896198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1356/2715] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:46.901006 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ad9b1-380a-46fe-a2aa-ecc4b10b4ce7 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:46.912400 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ad9b1-380a-46fe-a2aa-ecc4b10b4ce7 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:46.917111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98de0c-e7cc-4947-869d-d8b01fc1951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:46.918028 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98de0c-e7cc-4947-869d-d8b01fc1951d admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:46.918317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98de0c-e7cc-4947-869d-d8b01fc1951d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:46.918601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98de0c-e7cc-4947-869d-d8b01fc1951d admin admin] PATH_INFO: `/v3/projects/984e7e755ee1483d877d6b5d3ada46f2/users/9a80eec88ba84ef3bc84ca6a0359284f/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:46.933292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98de0c-e7cc-4947-869d-d8b01fc1951d admin admin] RBAC: Authorizing `identity:create_grant(project_id=984e7e755ee1483d877d6b5d3ada46f2, user_id=9a80eec88ba84ef3bc84ca6a0359284f, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:46.935833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98de0c-e7cc-4947-869d-d8b01fc1951d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:46.950886 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1360/2716] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:46 2022] PUT /identity/v3/projects/984e7e755ee1483d877d6b5d3ada46f2/users/9a80eec88ba84ef3bc84ca6a0359284f/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:46.962254 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56655bbe-91e2-4936-ab6a-fcd08c7fecb4 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:46.962619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56655bbe-91e2-4936-ab6a-fcd08c7fecb4 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:46.962966 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56655bbe-91e2-4936-ab6a-fcd08c7fecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:46.990307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-56655bbe-91e2-4936-ab6a-fcd08c7fecb4 None None] MFA Rules not processed for user `9a80eec88ba84ef3bc84ca6a0359284f`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:46.992149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-56655bbe-91e2-4936-ab6a-fcd08c7fecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:47.004461 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:47.068798 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1357/2717] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:47.079705 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98de0c-e7cc-4947-869d-d8b01fc1951d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:47.081550 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bb98de0c-e7cc-4947-869d-d8b01fc1951d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:47.153452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98de0c-e7cc-4947-869d-d8b01fc1951d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:47.159085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d037a99-bf16-46bd-aae3-75bd214289bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:47.159733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d037a99-bf16-46bd-aae3-75bd214289bd service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:47.160048 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d037a99-bf16-46bd-aae3-75bd214289bd service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:47.160331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d037a99-bf16-46bd-aae3-75bd214289bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:47.170024 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d037a99-bf16-46bd-aae3-75bd214289bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:47.171630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d037a99-bf16-46bd-aae3-75bd214289bd service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:47.181629 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1361/2718] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:47.234463 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56655bbe-91e2-4936-ab6a-fcd08c7fecb4 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:47.236051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-56655bbe-91e2-4936-ab6a-fcd08c7fecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:47.344811 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56655bbe-91e2-4936-ab6a-fcd08c7fecb4 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:47.350653 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bf3c7-1efb-4879-8bf2-7229316980e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dde39c6d85446a681dea24573f0d6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:47.351542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf3c7-1efb-4879-8bf2-7229316980e0 service placement] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:47.352587 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf3c7-1efb-4879-8bf2-7229316980e0 service placement] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:47.352921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bf3c7-1efb-4879-8bf2-7229316980e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:47.354799 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-fc7bf3c7-1efb-4879-8bf2-7229316980e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:47.367457 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bf3c7-1efb-4879-8bf2-7229316980e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:47.373836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bf3c7-1efb-4879-8bf2-7229316980e0 service placement] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:47.386953 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1358/2719] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:47.428943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d037a99-bf16-46bd-aae3-75bd214289bd service nova] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:47.480053 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:47.493192 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d037a99-bf16-46bd-aae3-75bd214289bd service nova] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:47.499369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:47.500823 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:47.500932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:47.501196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] PATH_INFO: `/v3/users/9a80eec88ba84ef3bc84ca6a0359284f` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:47.502404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a80eec88ba84ef3bc84ca6a0359284f)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:47.504375 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:47.560943 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a80eec88ba84ef3bc84ca6a0359284f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.561603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a80eec88ba84ef3bc84ca6a0359284f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.574509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a80eec88ba84ef3bc84ca6a0359284f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.575222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a80eec88ba84ef3bc84ca6a0359284f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.582734 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a80eec88ba84ef3bc84ca6a0359284f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.595125 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1362/2720] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:47 2022] DELETE /identity/v3/users/9a80eec88ba84ef3bc84ca6a0359284f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:47.599474 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20cd8a-ee0a-4437-a02c-ab2bdbdd290d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:47.599939 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20cd8a-ee0a-4437-a02c-ab2bdbdd290d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:47.600317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20cd8a-ee0a-4437-a02c-ab2bdbdd290d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:47.620974 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-5a20cd8a-ee0a-4437-a02c-ab2bdbdd290d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:47.622352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5a20cd8a-ee0a-4437-a02c-ab2bdbdd290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:47.697541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1359/2721] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:47.707152 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:47.708585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:47.785598 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20cd8a-ee0a-4437-a02c-ab2bdbdd290d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:47.787309 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-5a20cd8a-ee0a-4437-a02c-ab2bdbdd290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:47.800366 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9a97c-e747-4352-b072-f8e89a5d49e6 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:47.801127 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20cd8a-ee0a-4437-a02c-ab2bdbdd290d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:47.805123 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779bf2a-305e-4f46-a079-3da840b12baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:47.806635 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779bf2a-305e-4f46-a079-3da840b12baa service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:47.807140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779bf2a-305e-4f46-a079-3da840b12baa service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:47.807697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779bf2a-305e-4f46-a079-3da840b12baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:47.808091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b98c81-44dc-44cd-b516-fd002ccbb308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:47.809062 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98c81-44dc-44cd-b516-fd002ccbb308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:47.809426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98c81-44dc-44cd-b516-fd002ccbb308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:47.809782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98c81-44dc-44cd-b516-fd002ccbb308 admin admin] PATH_INFO: `/v3/users/1e9db9b792954dcba8db718c29923dda` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:47.811109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b98c81-44dc-44cd-b516-fd002ccbb308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9db9b792954dcba8db718c29923dda)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:47.813891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b98c81-44dc-44cd-b516-fd002ccbb308 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:47.820415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779bf2a-305e-4f46-a079-3da840b12baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:47.822077 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779bf2a-305e-4f46-a079-3da840b12baa service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:47.833457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1363/2722] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:47.857913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779bf2a-305e-4f46-a079-3da840b12baa service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:47.859513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d779bf2a-305e-4f46-a079-3da840b12baa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:47.860059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:47.871804 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a2b98c81-44dc-44cd-b516-fd002ccbb308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9db9b792954dcba8db718c29923dda'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.882093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779bf2a-305e-4f46-a079-3da840b12baa service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:47.886752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a2b98c81-44dc-44cd-b516-fd002ccbb308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9db9b792954dcba8db718c29923dda'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.887445 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:47.887769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a2b98c81-44dc-44cd-b516-fd002ccbb308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9db9b792954dcba8db718c29923dda'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.888626 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:47.888869 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:47.889234 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] PATH_INFO: `/v3/users/0918cc91d5874809857526485a8e73af` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:47.890908 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0918cc91d5874809857526485a8e73af)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:47.893248 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:47.899789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a2b98c81-44dc-44cd-b516-fd002ccbb308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9db9b792954dcba8db718c29923dda'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.910905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-a2b98c81-44dc-44cd-b516-fd002ccbb308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9db9b792954dcba8db718c29923dda'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.920367 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1360/2723] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:47 2022] DELETE /identity/v3/users/1e9db9b792954dcba8db718c29923dda => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:47.925879 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a4acc-d14e-4931-bcb1-6b5883d08a07 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:47.926406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a4acc-d14e-4931-bcb1-6b5883d08a07 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:47.927149 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a4acc-d14e-4931-bcb1-6b5883d08a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:47.950161 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-045a4acc-d14e-4931-bcb1-6b5883d08a07 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:47.951391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-045a4acc-d14e-4931-bcb1-6b5883d08a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:47.958935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0918cc91d5874809857526485a8e73af'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.959761 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0918cc91d5874809857526485a8e73af'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.975461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0918cc91d5874809857526485a8e73af'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.976137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0918cc91d5874809857526485a8e73af'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:47.979405 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:47.986115 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0918cc91d5874809857526485a8e73af'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.002018 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1364/2724] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:47 2022] DELETE /identity/v3/users/0918cc91d5874809857526485a8e73af => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:48.041183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1361/2725] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:48.052950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:48.054399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.123468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff271574-3a73-4b1d-a7a1-0bd04d10ced3 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:48.129075 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2a869-6247-404d-8534-f6b8a97a3e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:48.129932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a869-6247-404d-8534-f6b8a97a3e80 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.130247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a869-6247-404d-8534-f6b8a97a3e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.130499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a869-6247-404d-8534-f6b8a97a3e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.159118 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a4acc-d14e-4931-bcb1-6b5883d08a07 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:48.161368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-045a4acc-d14e-4931-bcb1-6b5883d08a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.184253 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a4acc-d14e-4931-bcb1-6b5883d08a07 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:48.201153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2a869-6247-404d-8534-f6b8a97a3e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:48.202863 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2a869-6247-404d-8534-f6b8a97a3e80 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:48.214452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1365/2726] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:31:48.215294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2a869-6247-404d-8534-f6b8a97a3e80 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:48.216646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-1cf2a869-6247-404d-8534-f6b8a97a3e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.229667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2a869-6247-404d-8534-f6b8a97a3e80 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:48.234651 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:48.235786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.235952 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.236317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] PATH_INFO: `/v3/projects/5ee343ab10574b168f25dd1ab090d615` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.237940 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee343ab10574b168f25dd1ab090d615)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:48.239985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:48.263737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:48.264959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.265269 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.265548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] PATH_INFO: `/v3/projects/984e7e755ee1483d877d6b5d3ada46f2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.267212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=984e7e755ee1483d877d6b5d3ada46f2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:48.269742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:48.298409 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee343ab10574b168f25dd1ab090d615', 'request_id': 'req-0f2a01c6-dada-4347-b458-d6448b1b6422'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.307352 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee343ab10574b168f25dd1ab090d615', 'request_id': 'req-0f2a01c6-dada-4347-b458-d6448b1b6422'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.314772 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee343ab10574b168f25dd1ab090d615', 'request_id': 'req-0f2a01c6-dada-4347-b458-d6448b1b6422'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.327088 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '984e7e755ee1483d877d6b5d3ada46f2', 'request_id': 'req-901fea17-9c22-4128-9768-9a08391e5d73'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.328272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] The token cache is being invalidate because project 5ee343ab10574b168f25dd1ab090d615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:48.328883 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.329864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.331557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1366/2727] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:48 2022] DELETE /identity/v3/projects/5ee343ab10574b168f25dd1ab090d615 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:48.335717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '984e7e755ee1483d877d6b5d3ada46f2', 'request_id': 'req-901fea17-9c22-4128-9768-9a08391e5d73'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.336172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:48.338520 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:48.338638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.345820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '984e7e755ee1483d877d6b5d3ada46f2', 'request_id': 'req-901fea17-9c22-4128-9768-9a08391e5d73'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.360165 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] The token cache is being invalidate because project 984e7e755ee1483d877d6b5d3ada46f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:48.360459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.361152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-901fea17-9c22-4128-9768-9a08391e5d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.362732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1362/2728] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:48 2022] DELETE /identity/v3/projects/984e7e755ee1483d877d6b5d3ada46f2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:48.367806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a1292-ea33-4ada-b452-c7e0dc5b9acb None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.368732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a1292-ea33-4ada-b452-c7e0dc5b9acb None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.369141 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a1292-ea33-4ada-b452-c7e0dc5b9acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.369920 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:48.393613 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7b0a1292-ea33-4ada-b452-c7e0dc5b9acb None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:48.394977 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7b0a1292-ea33-4ada-b452-c7e0dc5b9acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.430746 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a01c6-dada-4347-b458-d6448b1b6422 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:48.470824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1363/2729] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:48.479030 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b3d65-e285-4da8-96f1-15b3003bcd4b None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.479695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b3d65-e285-4da8-96f1-15b3003bcd4b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.480028 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b3d65-e285-4da8-96f1-15b3003bcd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.497729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:48.499273 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-996b3d65-e285-4da8-96f1-15b3003bcd4b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:48.499456 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.499841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.500262 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] PATH_INFO: `/v3/users/1f8164a201ce4861938fbe9b0d14692f` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.501122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-996b3d65-e285-4da8-96f1-15b3003bcd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.502047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8164a201ce4861938fbe9b0d14692f)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:48.503615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:48.511951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1364/2730] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:48.515416 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b3d65-e285-4da8-96f1-15b3003bcd4b None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:48.527085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b3d65-e285-4da8-96f1-15b3003bcd4b None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:48.535406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e4598-fe77-47f7-b411-bd5e399d8628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:48.536117 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e4598-fe77-47f7-b411-bd5e399d8628 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.536402 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e4598-fe77-47f7-b411-bd5e399d8628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.536709 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e4598-fe77-47f7-b411-bd5e399d8628 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.537439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e4598-fe77-47f7-b411-bd5e399d8628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:31:48.537722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e4598-fe77-47f7-b411-bd5e399d8628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:48.539317 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e4598-fe77-47f7-b411-bd5e399d8628 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:48.553725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1365/2731] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:31:48.554666 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e4598-fe77-47f7-b411-bd5e399d8628 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:48.556776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-481e4598-fe77-47f7-b411-bd5e399d8628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.566724 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8164a201ce4861938fbe9b0d14692f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.567510 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8164a201ce4861938fbe9b0d14692f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.571683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e4598-fe77-47f7-b411-bd5e399d8628 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:48.576714 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:48.577643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.578018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.578352 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] PATH_INFO: `/v3/projects/e5ff1b6d24244f779387cebfd852c5cf` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.579624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ff1b6d24244f779387cebfd852c5cf)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:48.581615 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:48.581979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8164a201ce4861938fbe9b0d14692f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.582664 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8164a201ce4861938fbe9b0d14692f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.591045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8164a201ce4861938fbe9b0d14692f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.604818 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1367/2732] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:48 2022] DELETE /identity/v3/users/1f8164a201ce4861938fbe9b0d14692f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:48.608795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:48.610280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.634928 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ff1b6d24244f779387cebfd852c5cf', 'request_id': 'req-280e27f1-93aa-49f3-a717-911828d893a3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.645736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ff1b6d24244f779387cebfd852c5cf', 'request_id': 'req-280e27f1-93aa-49f3-a717-911828d893a3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.659316 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ff1b6d24244f779387cebfd852c5cf', 'request_id': 'req-280e27f1-93aa-49f3-a717-911828d893a3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.662179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:48.677555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] The token cache is being invalidate because project e5ff1b6d24244f779387cebfd852c5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:48.678232 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.678941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.682446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1366/2733] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:48 2022] DELETE /identity/v3/projects/e5ff1b6d24244f779387cebfd852c5cf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:48.686134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:48.688664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.690695 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb9e73-9ea3-4c5a-80de-1f31524d57c8 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:48.753647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:48.773536 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e27f1-93aa-49f3-a717-911828d893a3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:48.774696 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed447b13-110f-4bce-a196-bc8f401ed7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:48.775576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed447b13-110f-4bce-a196-bc8f401ed7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.775930 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed447b13-110f-4bce-a196-bc8f401ed7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.776414 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed447b13-110f-4bce-a196-bc8f401ed7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.777140 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed447b13-110f-4bce-a196-bc8f401ed7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:48.779187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:48.779741 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed447b13-110f-4bce-a196-bc8f401ed7c7 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:48.780308 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.780667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.781019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] PATH_INFO: `/v3/users/322c0bea49ca4dc3a95dc4345ae0e1d4` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.782375 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=322c0bea49ca4dc3a95dc4345ae0e1d4)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:48.784588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:48.813272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1368/2734] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:48 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:48.814113 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed447b13-110f-4bce-a196-bc8f401ed7c7 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:48.815749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ed447b13-110f-4bce-a196-bc8f401ed7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.847684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322c0bea49ca4dc3a95dc4345ae0e1d4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.860343 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322c0bea49ca4dc3a95dc4345ae0e1d4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.861045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322c0bea49ca4dc3a95dc4345ae0e1d4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.870078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322c0bea49ca4dc3a95dc4345ae0e1d4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.877586 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322c0bea49ca4dc3a95dc4345ae0e1d4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:48.884215 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1367/2735] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:48 2022] DELETE /identity/v3/users/322c0bea49ca4dc3a95dc4345ae0e1d4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:48.884864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed447b13-110f-4bce-a196-bc8f401ed7c7 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:48.885060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:48.886546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:48.958840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:48.960184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.960438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.960729 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] PATH_INFO: `/v3/projects/5f77f707c05249f2b40bbf59ccb5f2db` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.962026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f77f707c05249f2b40bbf59ccb5f2db)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:48.964019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:48.974436 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f787f-fe7e-48ef-98e7-26efab7aa333 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:48.981155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f63563-e149-4522-a058-a165022cc478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:48.981867 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f63563-e149-4522-a058-a165022cc478 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:48.982152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f63563-e149-4522-a058-a165022cc478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:48.982430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f63563-e149-4522-a058-a165022cc478 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:48.983276 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f63563-e149-4522-a058-a165022cc478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:48.985264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f63563-e149-4522-a058-a165022cc478 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.005945 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:49.007992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1368/2736] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:48 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:49.013220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f63563-e149-4522-a058-a165022cc478 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.028623 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f77f707c05249f2b40bbf59ccb5f2db', 'request_id': 'req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:49.036769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f63563-e149-4522-a058-a165022cc478 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.039152 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f77f707c05249f2b40bbf59ccb5f2db', 'request_id': 'req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:49.047730 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f77f707c05249f2b40bbf59ccb5f2db', 'request_id': 'req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:49.067841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] The token cache is being invalidate because project 5f77f707c05249f2b40bbf59ccb5f2db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:49.068188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:49.069046 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2e54227a-8a51-4e2e-8a9d-e5fc9fccccd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:49.075711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1369/2737] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:48 2022] DELETE /identity/v3/projects/5f77f707c05249f2b40bbf59ccb5f2db => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:49.078047 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24e3c0-87e4-4598-965b-15c3b9c7369e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.078342 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24e3c0-87e4-4598-965b-15c3b9c7369e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.078619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24e3c0-87e4-4598-965b-15c3b9c7369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.098057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-5d24e3c0-87e4-4598-965b-15c3b9c7369e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:49.099438 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5d24e3c0-87e4-4598-965b-15c3b9c7369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:49.108732 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:49.119353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11e494-d22c-4bac-b075-f13acf4f63bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.120484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11e494-d22c-4bac-b075-f13acf4f63bd admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.121725 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11e494-d22c-4bac-b075-f13acf4f63bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.122230 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11e494-d22c-4bac-b075-f13acf4f63bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.123256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11e494-d22c-4bac-b075-f13acf4f63bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.125556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11e494-d22c-4bac-b075-f13acf4f63bd admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.139720 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1369/2738] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:31:49.143412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11e494-d22c-4bac-b075-f13acf4f63bd admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.146539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4d11e494-d22c-4bac-b075-f13acf4f63bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:49.164963 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11e494-d22c-4bac-b075-f13acf4f63bd admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.169945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5d75e-8dd9-42c7-b0ae-d345f40c38a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.170622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d75e-8dd9-42c7-b0ae-d345f40c38a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.170912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d75e-8dd9-42c7-b0ae-d345f40c38a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.171808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5d75e-8dd9-42c7-b0ae-d345f40c38a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.172694 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5d75e-8dd9-42c7-b0ae-d345f40c38a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.174323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5d75e-8dd9-42c7-b0ae-d345f40c38a9 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.187831 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1370/2739] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:31:49.192884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5d75e-8dd9-42c7-b0ae-d345f40c38a9 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.200919 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1370/2740] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:49.209220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438d6da-c530-4275-bfab-9e457d8fe107 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.209530 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438d6da-c530-4275-bfab-9e457d8fe107 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.209819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438d6da-c530-4275-bfab-9e457d8fe107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.210733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5d75e-8dd9-42c7-b0ae-d345f40c38a9 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.220971 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3ddf8-e33a-4113-be0b-169a6d92491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.222923 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3ddf8-e33a-4113-be0b-169a6d92491e admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.223286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3ddf8-e33a-4113-be0b-169a6d92491e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.230638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-4438d6da-c530-4275-bfab-9e457d8fe107 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:49.232182 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4438d6da-c530-4275-bfab-9e457d8fe107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:49.232336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3ddf8-e33a-4113-be0b-169a6d92491e admin admin] PATH_INFO: `/v3/projects/c3e76fd193f74af3b9ab201ce9ac4e25/users/92e3a04ed12f4af385ca31417cef6f78/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.241893 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1371/2741] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:49.247457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438d6da-c530-4275-bfab-9e457d8fe107 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.248868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4438d6da-c530-4275-bfab-9e457d8fe107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:49.251667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3ddf8-e33a-4113-be0b-169a6d92491e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e76fd193f74af3b9ab201ce9ac4e25, user_id=92e3a04ed12f4af385ca31417cef6f78, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.254561 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3ddf8-e33a-4113-be0b-169a6d92491e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.261365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438d6da-c530-4275-bfab-9e457d8fe107 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.267019 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.267932 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.268261 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.268531 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] PATH_INFO: `/v3/projects/56ee4863e9a04fad8da2f23843502c6e` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.269745 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ee4863e9a04fad8da2f23843502c6e)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.269860 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1371/2742] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:49 2022] PUT /identity/v3/projects/c3e76fd193f74af3b9ab201ce9ac4e25/users/92e3a04ed12f4af385ca31417cef6f78/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:49.270745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3ddf8-e33a-4113-be0b-169a6d92491e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.280979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.328710 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ee4863e9a04fad8da2f23843502c6e', 'request_id': 'req-58d23f08-de22-449c-a335-0ad55f388ea7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:49.337286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ee4863e9a04fad8da2f23843502c6e', 'request_id': 'req-58d23f08-de22-449c-a335-0ad55f388ea7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:49.337831 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3ddf8-e33a-4113-be0b-169a6d92491e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.343232 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ee4863e9a04fad8da2f23843502c6e', 'request_id': 'req-58d23f08-de22-449c-a335-0ad55f388ea7'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:49.354868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] The token cache is being invalidate because project 56ee4863e9a04fad8da2f23843502c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:49.354868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:49.355461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-58d23f08-de22-449c-a335-0ad55f388ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:49.357091 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1372/2743] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:49 2022] DELETE /identity/v3/projects/56ee4863e9a04fad8da2f23843502c6e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:49.361569 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314500a8-be5b-47dd-ba8a-e08686f5bebd None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.361569 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314500a8-be5b-47dd-ba8a-e08686f5bebd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.361569 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314500a8-be5b-47dd-ba8a-e08686f5bebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.385832 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-314500a8-be5b-47dd-ba8a-e08686f5bebd None None] MFA Rules not processed for user `92e3a04ed12f4af385ca31417cef6f78`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:49.387185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-314500a8-be5b-47dd-ba8a-e08686f5bebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:49.401116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9c708-3688-48b9-9ee1-9cc577b8563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.401806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9c708-3688-48b9-9ee1-9cc577b8563e admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.402091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9c708-3688-48b9-9ee1-9cc577b8563e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.402368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9c708-3688-48b9-9ee1-9cc577b8563e admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.403116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9c708-3688-48b9-9ee1-9cc577b8563e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:31:49.403423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9c708-3688-48b9-9ee1-9cc577b8563e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.405074 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9c708-3688-48b9-9ee1-9cc577b8563e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.405860 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:49.417287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1372/2744] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:31:49.418646 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fda88-489d-4b90-baf1-d2fec69a6454 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.418999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fda88-489d-4b90-baf1-d2fec69a6454 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.419401 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fda88-489d-4b90-baf1-d2fec69a6454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.438089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-275fda88-489d-4b90-baf1-d2fec69a6454 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:49.439490 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-275fda88-489d-4b90-baf1-d2fec69a6454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:49.454776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1373/2745] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:49.454776 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fda88-489d-4b90-baf1-d2fec69a6454 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.456101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-275fda88-489d-4b90-baf1-d2fec69a6454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:49.457675 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1373/2746] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:49.459020 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3131-1b85-4437-83b9-6249fb358dfd None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.459316 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3131-1b85-4437-83b9-6249fb358dfd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.459597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c3131-1b85-4437-83b9-6249fb358dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.468000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fda88-489d-4b90-baf1-d2fec69a6454 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.472573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e68517-8e8a-40a7-9746-761aae65775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.473234 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e68517-8e8a-40a7-9746-761aae65775d admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.473522 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e68517-8e8a-40a7-9746-761aae65775d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.473805 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e68517-8e8a-40a7-9746-761aae65775d admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.474498 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e68517-8e8a-40a7-9746-761aae65775d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.476438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e68517-8e8a-40a7-9746-761aae65775d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.477654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-767c3131-1b85-4437-83b9-6249fb358dfd None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:49.478850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-767c3131-1b85-4437-83b9-6249fb358dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:49.486914 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1374/2747] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:49.487727 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c3131-1b85-4437-83b9-6249fb358dfd None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.488984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-767c3131-1b85-4437-83b9-6249fb358dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:49.501796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c3131-1b85-4437-83b9-6249fb358dfd None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.509820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1374/2748] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:49.509987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00718b7f-a9aa-4379-bd51-baaa559419ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.510100 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e68517-8e8a-40a7-9746-761aae65775d admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.510201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00718b7f-a9aa-4379-bd51-baaa559419ec admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.510201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00718b7f-a9aa-4379-bd51-baaa559419ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.510201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00718b7f-a9aa-4379-bd51-baaa559419ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.510201 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00718b7f-a9aa-4379-bd51-baaa559419ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.511100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00718b7f-a9aa-4379-bd51-baaa559419ec admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.536613 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1375/2749] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:49.537479 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00718b7f-a9aa-4379-bd51-baaa559419ec admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.545689 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:49.578629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e68517-8e8a-40a7-9746-761aae65775d admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.600175 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00718b7f-a9aa-4379-bd51-baaa559419ec admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.606343 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5b944-2a76-406a-a330-2e718fcbf176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.607277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b944-2a76-406a-a330-2e718fcbf176 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.608055 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b944-2a76-406a-a330-2e718fcbf176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.608355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b944-2a76-406a-a330-2e718fcbf176 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.609080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5b944-2a76-406a-a330-2e718fcbf176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.610998 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5b944-2a76-406a-a330-2e718fcbf176 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.635007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1376/2750] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:49.635007 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5b944-2a76-406a-a330-2e718fcbf176 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.641539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11a9c7-7b18-4668-a1e9-fadd52ef2871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.642243 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11a9c7-7b18-4668-a1e9-fadd52ef2871 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.642449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5b944-2a76-406a-a330-2e718fcbf176 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.642565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11a9c7-7b18-4668-a1e9-fadd52ef2871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.642801 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11a9c7-7b18-4668-a1e9-fadd52ef2871 admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.643528 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11a9c7-7b18-4668-a1e9-fadd52ef2871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:31:49.643842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11a9c7-7b18-4668-a1e9-fadd52ef2871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.645677 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11a9c7-7b18-4668-a1e9-fadd52ef2871 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.647161 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861648a6-4d15-4010-846d-bf88376365fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.647811 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861648a6-4d15-4010-846d-bf88376365fa admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.648168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861648a6-4d15-4010-846d-bf88376365fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.648449 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861648a6-4d15-4010-846d-bf88376365fa admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.649147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861648a6-4d15-4010-846d-bf88376365fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.651012 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861648a6-4d15-4010-846d-bf88376365fa admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.661195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1375/2751] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:31:49.661195 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11a9c7-7b18-4668-a1e9-fadd52ef2871 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.669067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11a9c7-7b18-4668-a1e9-fadd52ef2871 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.672021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1377/2752] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/users => generated 299 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:49.672858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861648a6-4d15-4010-846d-bf88376365fa admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.676491 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05d942-220d-4c18-88cf-bba8262d8934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.677250 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d942-220d-4c18-88cf-bba8262d8934 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.677538 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d942-220d-4c18-88cf-bba8262d8934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.677824 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d942-220d-4c18-88cf-bba8262d8934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.678557 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05d942-220d-4c18-88cf-bba8262d8934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.680702 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05d942-220d-4c18-88cf-bba8262d8934 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.684155 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861648a6-4d15-4010-846d-bf88376365fa admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.688815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ff710-d2aa-41ce-983b-00c9e38d9945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.689464 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ff710-d2aa-41ce-983b-00c9e38d9945 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.689756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ff710-d2aa-41ce-983b-00c9e38d9945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.690039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ff710-d2aa-41ce-983b-00c9e38d9945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.690958 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ff710-d2aa-41ce-983b-00c9e38d9945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.691071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1376/2753] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:49.691734 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05d942-220d-4c18-88cf-bba8262d8934 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.692926 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ff710-d2aa-41ce-983b-00c9e38d9945 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.702528 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05d942-220d-4c18-88cf-bba8262d8934 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.707760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4d1de-5c47-4f30-9628-70d314cbccf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.708439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4d1de-5c47-4f30-9628-70d314cbccf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.708726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4d1de-5c47-4f30-9628-70d314cbccf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.709010 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4d1de-5c47-4f30-9628-70d314cbccf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.709967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4d1de-5c47-4f30-9628-70d314cbccf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.711843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4d1de-5c47-4f30-9628-70d314cbccf5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.723571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1378/2754] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:49.723571 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ff710-d2aa-41ce-983b-00c9e38d9945 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.723808 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1377/2755] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:49.724934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4d1de-5c47-4f30-9628-70d314cbccf5 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.734458 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4d1de-5c47-4f30-9628-70d314cbccf5 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.769184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:49.788615 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ff710-d2aa-41ce-983b-00c9e38d9945 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.792973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b32eb-0fee-4926-8c3a-c9eb72a389ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.793152 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f5d14-35b1-49e5-8c82-86497c3003c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.793792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b32eb-0fee-4926-8c3a-c9eb72a389ee admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.793906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5d14-35b1-49e5-8c82-86497c3003c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.794087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5d14-35b1-49e5-8c82-86497c3003c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.794186 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b32eb-0fee-4926-8c3a-c9eb72a389ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.794368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5d14-35b1-49e5-8c82-86497c3003c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.794477 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b32eb-0fee-4926-8c3a-c9eb72a389ee admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.795061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b32eb-0fee-4926-8c3a-c9eb72a389ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.795160 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f5d14-35b1-49e5-8c82-86497c3003c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.796711 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f5d14-35b1-49e5-8c82-86497c3003c7 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.797157 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b32eb-0fee-4926-8c3a-c9eb72a389ee admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.807240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1379/2756] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:49.808251 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f5d14-35b1-49e5-8c82-86497c3003c7 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.818485 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f5d14-35b1-49e5-8c82-86497c3003c7 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.823663 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1378/2757] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:31:49.823663 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b32eb-0fee-4926-8c3a-c9eb72a389ee admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.823927 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1b980-4653-4efb-8c94-632bb2fdb132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.824585 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b980-4653-4efb-8c94-632bb2fdb132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.824863 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b980-4653-4efb-8c94-632bb2fdb132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.825135 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b980-4653-4efb-8c94-632bb2fdb132 admin admin] PATH_INFO: `/v3/projects/ecfd0c07112e4a4a903369ad9598c776/users/c88324b29f254355bb3acb91516e0cdd/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.830871 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b32eb-0fee-4926-8c3a-c9eb72a389ee admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.837021 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f325519-68f5-4a9a-a6f0-d5b745e29f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.837956 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f325519-68f5-4a9a-a6f0-d5b745e29f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.838287 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f325519-68f5-4a9a-a6f0-d5b745e29f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.838657 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f325519-68f5-4a9a-a6f0-d5b745e29f3c admin admin] PATH_INFO: `/v3/projects/4cd5c8b33d2c4a0d8c5cfa4be051d800/users/9232ac8e75754578ae4573b11065a9d2/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.841474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1b980-4653-4efb-8c94-632bb2fdb132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfd0c07112e4a4a903369ad9598c776, user_id=c88324b29f254355bb3acb91516e0cdd, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.844197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1b980-4653-4efb-8c94-632bb2fdb132 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.856757 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f325519-68f5-4a9a-a6f0-d5b745e29f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd5c8b33d2c4a0d8c5cfa4be051d800, user_id=9232ac8e75754578ae4573b11065a9d2, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.859642 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f325519-68f5-4a9a-a6f0-d5b745e29f3c admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.859782 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1380/2758] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:49 2022] PUT /identity/v3/projects/ecfd0c07112e4a4a903369ad9598c776/users/c88324b29f254355bb3acb91516e0cdd/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:49.860720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1b980-4653-4efb-8c94-632bb2fdb132 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.877947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1379/2759] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:49 2022] PUT /identity/v3/projects/4cd5c8b33d2c4a0d8c5cfa4be051d800/users/9232ac8e75754578ae4573b11065a9d2/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:49.878910 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f325519-68f5-4a9a-a6f0-d5b745e29f3c admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:49.905116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:49.932180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1b980-4653-4efb-8c94-632bb2fdb132 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.953843 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f325519-68f5-4a9a-a6f0-d5b745e29f3c admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:49.959151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab9039-c075-4fbe-bf90-a7c473a4b3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.959891 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9039-c075-4fbe-bf90-a7c473a4b3eb admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.960212 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9039-c075-4fbe-bf90-a7c473a4b3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.960497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9039-c075-4fbe-bf90-a7c473a4b3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.961256 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab9039-c075-4fbe-bf90-a7c473a4b3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.962864 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab9039-c075-4fbe-bf90-a7c473a4b3eb admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:49.972760 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1380/2760] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:49.974045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3705c8-30b5-49db-8237-dc13eaba75ae None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.974278 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3705c8-30b5-49db-8237-dc13eaba75ae None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.974559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3705c8-30b5-49db-8237-dc13eaba75ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.993648 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccf2c6-b206-4d18-bb44-d1baec7b489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:49.994320 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccf2c6-b206-4d18-bb44-d1baec7b489d admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:49.994603 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccf2c6-b206-4d18-bb44-d1baec7b489d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:49.994879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccf2c6-b206-4d18-bb44-d1baec7b489d admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:49.995714 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccf2c6-b206-4d18-bb44-d1baec7b489d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:49.997349 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccf2c6-b206-4d18-bb44-d1baec7b489d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:50.000829 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-8f3705c8-30b5-49db-8237-dc13eaba75ae None None] MFA Rules not processed for user `9232ac8e75754578ae4573b11065a9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:50.002042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8f3705c8-30b5-49db-8237-dc13eaba75ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:50.007712 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1381/2761] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:50.011783 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccf2c6-b206-4d18-bb44-d1baec7b489d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:50.022098 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccf2c6-b206-4d18-bb44-d1baec7b489d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:50.027176 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952e6d4-9639-4951-a204-c9061c44f71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:50.028094 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952e6d4-9639-4951-a204-c9061c44f71b admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.028385 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952e6d4-9639-4951-a204-c9061c44f71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:50.028673 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952e6d4-9639-4951-a204-c9061c44f71b admin admin] PATH_INFO: `/v3/projects/ecfd0c07112e4a4a903369ad9598c776/users/c88324b29f254355bb3acb91516e0cdd/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:50.030738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952e6d4-9639-4951-a204-c9061c44f71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfd0c07112e4a4a903369ad9598c776, user_id=c88324b29f254355bb3acb91516e0cdd, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:50.033404 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952e6d4-9639-4951-a204-c9061c44f71b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:50.044172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1382/2762] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:50 2022] PUT /identity/v3/projects/ecfd0c07112e4a4a903369ad9598c776/users/c88324b29f254355bb3acb91516e0cdd/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:50.046713 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952e6d4-9639-4951-a204-c9061c44f71b admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:50.073833 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1381/2763] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:50.078102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154f510-eec6-42f0-b0e9-ef435df7ea60 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.078102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154f510-eec6-42f0-b0e9-ef435df7ea60 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:50.078102 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154f510-eec6-42f0-b0e9-ef435df7ea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:50.099217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:50.104260 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4154f510-eec6-42f0-b0e9-ef435df7ea60 None None] MFA Rules not processed for user `c88324b29f254355bb3acb91516e0cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:50.105819 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4154f510-eec6-42f0-b0e9-ef435df7ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:50.117340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952e6d4-9639-4951-a204-c9061c44f71b admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:50.123042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93771214-40f5-417b-b939-ecb44dd9844d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:50.123722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771214-40f5-417b-b939-ecb44dd9844d admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.124039 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771214-40f5-417b-b939-ecb44dd9844d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:50.124323 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771214-40f5-417b-b939-ecb44dd9844d admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:50.125059 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93771214-40f5-417b-b939-ecb44dd9844d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:50.126659 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93771214-40f5-417b-b939-ecb44dd9844d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:50.136841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1383/2764] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:50.137641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93771214-40f5-417b-b939-ecb44dd9844d admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:50.139341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-93771214-40f5-417b-b939-ecb44dd9844d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:50.177056 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1382/2765] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:50.178185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154f510-eec6-42f0-b0e9-ef435df7ea60 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:50.189343 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154f510-eec6-42f0-b0e9-ef435df7ea60 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:50.194185 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c242d-43b5-44cc-b626-32e6c7afaae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:50.195072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c242d-43b5-44cc-b626-32e6c7afaae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.195368 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c242d-43b5-44cc-b626-32e6c7afaae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:50.195673 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c242d-43b5-44cc-b626-32e6c7afaae3 admin admin] PATH_INFO: `/v3/projects/b7432aad587d49f5a2d6bced6ba847b8/users/2b84e5d2bf0947619bc073f85e1f38b3/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:50.200461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93771214-40f5-417b-b939-ecb44dd9844d admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:50.204151 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205e1eb-592a-4f17-be16-4129a88d3f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:50.204795 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205e1eb-592a-4f17-be16-4129a88d3f04 service cinder] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.205085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205e1eb-592a-4f17-be16-4129a88d3f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:50.205365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205e1eb-592a-4f17-be16-4129a88d3f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:50.210143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c242d-43b5-44cc-b626-32e6c7afaae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7432aad587d49f5a2d6bced6ba847b8, user_id=2b84e5d2bf0947619bc073f85e1f38b3, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:50.213392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c242d-43b5-44cc-b626-32e6c7afaae3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:50.226938 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1383/2766] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:50 2022] PUT /identity/v3/projects/b7432aad587d49f5a2d6bced6ba847b8/users/2b84e5d2bf0947619bc073f85e1f38b3/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:50.228068 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c242d-43b5-44cc-b626-32e6c7afaae3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:50.229672 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-932c242d-43b5-44cc-b626-32e6c7afaae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:50.235343 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:50.266959 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205e1eb-592a-4f17-be16-4129a88d3f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:50.268658 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205e1eb-592a-4f17-be16-4129a88d3f04 service cinder] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:50.278534 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1384/2767] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:50.279806 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b7637-b0cb-4bda-b1cf-17504c472d26 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.280141 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b7637-b0cb-4bda-b1cf-17504c472d26 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:50.280424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b7637-b0cb-4bda-b1cf-17504c472d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:50.292691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c242d-43b5-44cc-b626-32e6c7afaae3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:50.297679 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb44d-7a79-4f70-8e33-0f0141338b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:50.298417 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb44d-7a79-4f70-8e33-0f0141338b35 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.298797 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb44d-7a79-4f70-8e33-0f0141338b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:50.299392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb44d-7a79-4f70-8e33-0f0141338b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:50.308389 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-d36b7637-b0cb-4bda-b1cf-17504c472d26 None None] MFA Rules not processed for user `2b84e5d2bf0947619bc073f85e1f38b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:50.309851 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d36b7637-b0cb-4bda-b1cf-17504c472d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:50.369393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb44d-7a79-4f70-8e33-0f0141338b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:50.370942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb44d-7a79-4f70-8e33-0f0141338b35 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:50.381027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1384/2768] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:50.389325 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1385/2769] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:50.420637 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb44d-7a79-4f70-8e33-0f0141338b35 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:50.429978 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb44d-7a79-4f70-8e33-0f0141338b35 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:50.433771 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d8ba7-eda1-460f-81c3-60ea6c5ab7ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:50.434452 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8ba7-eda1-460f-81c3-60ea6c5ab7ab service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:50.434711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8ba7-eda1-460f-81c3-60ea6c5ab7ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:50.434997 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8ba7-eda1-460f-81c3-60ea6c5ab7ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:50.444455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d8ba7-eda1-460f-81c3-60ea6c5ab7ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:50.445933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d8ba7-eda1-460f-81c3-60ea6c5ab7ab service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:50.455823 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1385/2770] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:51.095111 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b7637-b0cb-4bda-b1cf-17504c472d26 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:51.121326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:51.156802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b7637-b0cb-4bda-b1cf-17504c472d26 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:51.161238 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:51.162106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:51.162388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:51.162662 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] PATH_INFO: `/v3/users/92e3a04ed12f4af385ca31417cef6f78` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:51.163864 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e3a04ed12f4af385ca31417cef6f78)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:51.165825 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:51.210562 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e3a04ed12f4af385ca31417cef6f78'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.211236 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e3a04ed12f4af385ca31417cef6f78'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.223149 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e3a04ed12f4af385ca31417cef6f78'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.223824 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e3a04ed12f4af385ca31417cef6f78'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.230910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e3a04ed12f4af385ca31417cef6f78'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.243521 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1386/2771] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:51 2022] DELETE /identity/v3/users/92e3a04ed12f4af385ca31417cef6f78 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:51.248018 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761aa8-a861-46a1-ae2c-ed3a6d28c582 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:51.248467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761aa8-a861-46a1-ae2c-ed3a6d28c582 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:51.248620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761aa8-a861-46a1-ae2c-ed3a6d28c582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:51.265934 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-38761aa8-a861-46a1-ae2c-ed3a6d28c582 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:51.267129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-38761aa8-a861-46a1-ae2c-ed3a6d28c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:51.325751 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1386/2772] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:51.335188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:51.336605 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:51.392460 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ed685-4757-4d65-afd9-39e698362191 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:51.396147 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcf926-8841-4450-9be2-d2cc76bb7c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:51.396786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf926-8841-4450-9be2-d2cc76bb7c53 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:51.397072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf926-8841-4450-9be2-d2cc76bb7c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:51.397350 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcf926-8841-4450-9be2-d2cc76bb7c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:51.406235 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcf926-8841-4450-9be2-d2cc76bb7c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:51.407655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcf926-8841-4450-9be2-d2cc76bb7c53 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:51.417491 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1387/2773] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:51.679045 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38761aa8-a861-46a1-ae2c-ed3a6d28c582 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:51.681154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-38761aa8-a861-46a1-ae2c-ed3a6d28c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:51.693647 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38761aa8-a861-46a1-ae2c-ed3a6d28c582 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:51.698315 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:51.699183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:51.699473 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:51.699755 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] PATH_INFO: `/v3/projects/c3e76fd193f74af3b9ab201ce9ac4e25` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:51.701006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e76fd193f74af3b9ab201ce9ac4e25)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:51.702915 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:51.742532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:51.758054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e76fd193f74af3b9ab201ce9ac4e25', 'request_id': 'req-21091145-ab22-4907-a788-5555f193a7e4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.765641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e76fd193f74af3b9ab201ce9ac4e25', 'request_id': 'req-21091145-ab22-4907-a788-5555f193a7e4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.771364 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e76fd193f74af3b9ab201ce9ac4e25', 'request_id': 'req-21091145-ab22-4907-a788-5555f193a7e4'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.786304 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] The token cache is being invalidate because project c3e76fd193f74af3b9ab201ce9ac4e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:51.786442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.787220 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-21091145-ab22-4907-a788-5555f193a7e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.788975 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1387/2774] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:51 2022] DELETE /identity/v3/projects/c3e76fd193f74af3b9ab201ce9ac4e25 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:51.793733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcf926-8841-4450-9be2-d2cc76bb7c53 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:51.806478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcf926-8841-4450-9be2-d2cc76bb7c53 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:51.838882 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c16663-4949-4714-ba43-a74c0774a4b0 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:51.839179 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c16663-4949-4714-ba43-a74c0774a4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:51.839462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c16663-4949-4714-ba43-a74c0774a4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:51.859054 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-99c16663-4949-4714-ba43-a74c0774a4b0 None None] MFA Rules not processed for user `2b84e5d2bf0947619bc073f85e1f38b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:51.860467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-99c16663-4949-4714-ba43-a74c0774a4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:51.867356 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:51.885005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857efd8a-6c57-442b-8167-eb16881d9f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:51.885971 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efd8a-6c57-442b-8167-eb16881d9f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:51.886420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efd8a-6c57-442b-8167-eb16881d9f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:51.886707 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efd8a-6c57-442b-8167-eb16881d9f8f admin admin] PATH_INFO: `/v3/users/c88324b29f254355bb3acb91516e0cdd` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:51.888066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857efd8a-6c57-442b-8167-eb16881d9f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88324b29f254355bb3acb91516e0cdd)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:51.890171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857efd8a-6c57-442b-8167-eb16881d9f8f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:51.938450 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1388/2775] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:51.957504 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-857efd8a-6c57-442b-8167-eb16881d9f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88324b29f254355bb3acb91516e0cdd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.958178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-857efd8a-6c57-442b-8167-eb16881d9f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88324b29f254355bb3acb91516e0cdd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.974280 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-857efd8a-6c57-442b-8167-eb16881d9f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88324b29f254355bb3acb91516e0cdd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.975104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-857efd8a-6c57-442b-8167-eb16881d9f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88324b29f254355bb3acb91516e0cdd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:51.985515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-857efd8a-6c57-442b-8167-eb16881d9f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88324b29f254355bb3acb91516e0cdd'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:52.000373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1388/2776] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:51 2022] DELETE /identity/v3/users/c88324b29f254355bb3acb91516e0cdd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:52.510651 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c16663-4949-4714-ba43-a74c0774a4b0 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:52.512259 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-99c16663-4949-4714-ba43-a74c0774a4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:52.526433 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c16663-4949-4714-ba43-a74c0774a4b0 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:52.592916 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:52.593984 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:52.594335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:52.594777 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] PATH_INFO: `/v3/projects/ecfd0c07112e4a4a903369ad9598c776` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:52.596091 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecfd0c07112e4a4a903369ad9598c776)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:52.598119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:52.647680 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecfd0c07112e4a4a903369ad9598c776', 'request_id': 'req-578b9796-9f25-47bd-8237-72b801724cf1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:52.655621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecfd0c07112e4a4a903369ad9598c776', 'request_id': 'req-578b9796-9f25-47bd-8237-72b801724cf1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:52.661641 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecfd0c07112e4a4a903369ad9598c776', 'request_id': 'req-578b9796-9f25-47bd-8237-72b801724cf1'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:52.668959 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:52.673692 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] The token cache is being invalidate because project ecfd0c07112e4a4a903369ad9598c776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:52.673992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:52.675211 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-578b9796-9f25-47bd-8237-72b801724cf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:52.677049 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1389/2777] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:52 2022] DELETE /identity/v3/projects/ecfd0c07112e4a4a903369ad9598c776 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:52.682480 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4e6e-4fef-488f-a217-82f80eaf8cbb None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:52.682948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4e6e-4fef-488f-a217-82f80eaf8cbb None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:52.683281 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f4e6e-4fef-488f-a217-82f80eaf8cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:52.702413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b17f4e6e-4fef-488f-a217-82f80eaf8cbb None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:52.703737 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b17f4e6e-4fef-488f-a217-82f80eaf8cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:52.767605 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1389/2778] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:52.776174 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b9f96-9551-4781-9178-f12cd54c5a93 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:52.776530 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b9f96-9551-4781-9178-f12cd54c5a93 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:52.776880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b9f96-9551-4781-9178-f12cd54c5a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:52.796616 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7e5b9f96-9551-4781-9178-f12cd54c5a93 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:52.797749 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7e5b9f96-9551-4781-9178-f12cd54c5a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:52.806247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1390/2779] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:52.810519 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f4e6e-4fef-488f-a217-82f80eaf8cbb None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:52.821220 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f4e6e-4fef-488f-a217-82f80eaf8cbb None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:52.825840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc580c-9d4d-4e1b-8f79-8c783444f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:52.826499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc580c-9d4d-4e1b-8f79-8c783444f155 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:52.826777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc580c-9d4d-4e1b-8f79-8c783444f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:52.827067 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc580c-9d4d-4e1b-8f79-8c783444f155 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:52.827794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc580c-9d4d-4e1b-8f79-8c783444f155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:31:52.828146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc580c-9d4d-4e1b-8f79-8c783444f155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:52.829740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc580c-9d4d-4e1b-8f79-8c783444f155 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:52.841511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1390/2780] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:31:52.846182 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b9f96-9551-4781-9178-f12cd54c5a93 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:52.856722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b9f96-9551-4781-9178-f12cd54c5a93 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:52.862034 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707beeb-c45e-4654-966d-ca0d33be606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:52.862705 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707beeb-c45e-4654-966d-ca0d33be606b admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:52.862990 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707beeb-c45e-4654-966d-ca0d33be606b admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:52.863265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707beeb-c45e-4654-966d-ca0d33be606b admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:52.863989 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707beeb-c45e-4654-966d-ca0d33be606b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:52.866425 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707beeb-c45e-4654-966d-ca0d33be606b admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:52.892733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1391/2781] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:52 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:52.896933 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc580c-9d4d-4e1b-8f79-8c783444f155 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:52.910063 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc580c-9d4d-4e1b-8f79-8c783444f155 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:52.963422 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:52.974144 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc70cb-93d9-4ec9-88e5-f4bd03849396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:52.975215 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc70cb-93d9-4ec9-88e5-f4bd03849396 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:52.975756 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc70cb-93d9-4ec9-88e5-f4bd03849396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:52.976089 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc70cb-93d9-4ec9-88e5-f4bd03849396 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:52.977440 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc70cb-93d9-4ec9-88e5-f4bd03849396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:52.979365 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc70cb-93d9-4ec9-88e5-f4bd03849396 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:53.000645 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1391/2782] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:52 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:53.004440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707beeb-c45e-4654-966d-ca0d33be606b admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:53.015071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707beeb-c45e-4654-966d-ca0d33be606b admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:53.019775 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cb716-2d74-4f51-ae12-3b3bd3343573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:53.020584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cb716-2d74-4f51-ae12-3b3bd3343573 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:53.020996 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cb716-2d74-4f51-ae12-3b3bd3343573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:53.021282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cb716-2d74-4f51-ae12-3b3bd3343573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:53.022013 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cb716-2d74-4f51-ae12-3b3bd3343573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:53.023686 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cb716-2d74-4f51-ae12-3b3bd3343573 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:53.034629 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1392/2783] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:53.038595 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc70cb-93d9-4ec9-88e5-f4bd03849396 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:53.049396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc70cb-93d9-4ec9-88e5-f4bd03849396 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:53.054012 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdf4c9-f926-4e94-8d5f-c77bab01dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:53.054683 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdf4c9-f926-4e94-8d5f-c77bab01dadd admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:53.055923 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdf4c9-f926-4e94-8d5f-c77bab01dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:53.056240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdf4c9-f926-4e94-8d5f-c77bab01dadd admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:53.057001 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdf4c9-f926-4e94-8d5f-c77bab01dadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:53.058578 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdf4c9-f926-4e94-8d5f-c77bab01dadd admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:53.073360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1392/2784] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:53.077588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cb716-2d74-4f51-ae12-3b3bd3343573 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:53.087836 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cb716-2d74-4f51-ae12-3b3bd3343573 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:53.089499 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdf4c9-f926-4e94-8d5f-c77bab01dadd admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:53.091327 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-2dfdf4c9-f926-4e94-8d5f-c77bab01dadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:53.092739 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319f9e9-d73c-4195-a0fb-38348bdffa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:53.093674 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f9e9-d73c-4195-a0fb-38348bdffa08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:53.094026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f9e9-d73c-4195-a0fb-38348bdffa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:53.094424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319f9e9-d73c-4195-a0fb-38348bdffa08 admin admin] PATH_INFO: `/v3/projects/594f8bfb9bd24db9af5a00a7371bdbd6/users/799e1189c83b40588fe5e2d84af3ae96/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:53.106704 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdf4c9-f926-4e94-8d5f-c77bab01dadd admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:53.110282 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319f9e9-d73c-4195-a0fb-38348bdffa08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594f8bfb9bd24db9af5a00a7371bdbd6, user_id=799e1189c83b40588fe5e2d84af3ae96, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:53.112415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7b25b-41f9-496e-82d3-3efd69ebc762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:53.113156 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319f9e9-d73c-4195-a0fb-38348bdffa08 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:53.113372 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7b25b-41f9-496e-82d3-3efd69ebc762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:53.113669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7b25b-41f9-496e-82d3-3efd69ebc762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:53.113953 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7b25b-41f9-496e-82d3-3efd69ebc762 admin admin] PATH_INFO: `/v3/users/9232ac8e75754578ae4573b11065a9d2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:53.115557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7b25b-41f9-496e-82d3-3efd69ebc762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9232ac8e75754578ae4573b11065a9d2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:53.117387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7b25b-41f9-496e-82d3-3efd69ebc762 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:53.129346 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1393/2785] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:53 2022] PUT /identity/v3/projects/594f8bfb9bd24db9af5a00a7371bdbd6/users/799e1189c83b40588fe5e2d84af3ae96/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:53.139424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e1f8-99ce-4b62-af64-dcc86d819597 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:53.139717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e1f8-99ce-4b62-af64-dcc86d819597 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:53.140027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019e1f8-99ce-4b62-af64-dcc86d819597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:53.166258 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-6019e1f8-99ce-4b62-af64-dcc86d819597 None None] MFA Rules not processed for user `799e1189c83b40588fe5e2d84af3ae96`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:53.167451 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6019e1f8-99ce-4b62-af64-dcc86d819597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:53.169042 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c7a7b25b-41f9-496e-82d3-3efd69ebc762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9232ac8e75754578ae4573b11065a9d2'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:53.169720 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c7a7b25b-41f9-496e-82d3-3efd69ebc762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9232ac8e75754578ae4573b11065a9d2'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:53.182748 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c7a7b25b-41f9-496e-82d3-3efd69ebc762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9232ac8e75754578ae4573b11065a9d2'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:53.183430 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c7a7b25b-41f9-496e-82d3-3efd69ebc762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9232ac8e75754578ae4573b11065a9d2'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:53.190525 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-c7a7b25b-41f9-496e-82d3-3efd69ebc762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9232ac8e75754578ae4573b11065a9d2'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:53.202949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1393/2786] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:31:53 2022] DELETE /identity/v3/users/9232ac8e75754578ae4573b11065a9d2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:31:53.207247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b71f3-1e78-4b82-b8ac-9592dfef86cc None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:53.207544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b71f3-1e78-4b82-b8ac-9592dfef86cc None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:53.207827 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b71f3-1e78-4b82-b8ac-9592dfef86cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:53.224852 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b37b71f3-1e78-4b82-b8ac-9592dfef86cc None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:53.226326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b37b71f3-1e78-4b82-b8ac-9592dfef86cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:53.231660 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1394/2787] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:53.243503 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019e1f8-99ce-4b62-af64-dcc86d819597 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:53.244967 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-6019e1f8-99ce-4b62-af64-dcc86d819597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:53.287897 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1394/2788] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:53.297882 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b71f3-1e78-4b82-b8ac-9592dfef86cc None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:53.299222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b37b71f3-1e78-4b82-b8ac-9592dfef86cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:53.304961 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019e1f8-99ce-4b62-af64-dcc86d819597 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:53.343264 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:53.345418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:53.357342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988aaca-93ae-4901-b903-860e2d72851e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee61aece9c64e74806248e4ac49cd47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:53.358000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988aaca-93ae-4901-b903-860e2d72851e service glance] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:53.358286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988aaca-93ae-4901-b903-860e2d72851e service glance] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:53.358556 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988aaca-93ae-4901-b903-860e2d72851e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:53.359174 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b71f3-1e78-4b82-b8ac-9592dfef86cc None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:53.363178 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a76c8-ebfc-4624-9422-00665ccdd1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:53.363830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a76c8-ebfc-4624-9422-00665ccdd1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:53.364154 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a76c8-ebfc-4624-9422-00665ccdd1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:53.364556 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a76c8-ebfc-4624-9422-00665ccdd1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:53.373763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a76c8-ebfc-4624-9422-00665ccdd1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:53.375260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a76c8-ebfc-4624-9422-00665ccdd1a1 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:53.385254 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1395/2789] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:31:53.423485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988aaca-93ae-4901-b903-860e2d72851e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:53.424968 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988aaca-93ae-4901-b903-860e2d72851e service glance] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:53.434454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1395/2790] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:53.865043 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a76c8-ebfc-4624-9422-00665ccdd1a1 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:53.866811 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f77a76c8-ebfc-4624-9422-00665ccdd1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:53.902508 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a76c8-ebfc-4624-9422-00665ccdd1a1 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:53.916152 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:53.918888 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:53.919193 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:53.920442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] PATH_INFO: `/v3/projects/4cd5c8b33d2c4a0d8c5cfa4be051d800` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:53.924056 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd5c8b33d2c4a0d8c5cfa4be051d800)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:53.927060 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:54.013256 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd5c8b33d2c4a0d8c5cfa4be051d800', 'request_id': 'req-6011c895-a8c5-4d90-8676-182cf7f63885'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:54.026905 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd5c8b33d2c4a0d8c5cfa4be051d800', 'request_id': 'req-6011c895-a8c5-4d90-8676-182cf7f63885'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:54.033871 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd5c8b33d2c4a0d8c5cfa4be051d800', 'request_id': 'req-6011c895-a8c5-4d90-8676-182cf7f63885'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:54.046122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] The token cache is being invalidate because project 4cd5c8b33d2c4a0d8c5cfa4be051d800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:31:54.046416 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:54.047081 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-6011c895-a8c5-4d90-8676-182cf7f63885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:31:54.049272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1396/2791] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:31:53 2022] DELETE /identity/v3/projects/4cd5c8b33d2c4a0d8c5cfa4be051d800 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:54.054464 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c38e74-7334-40ad-9f72-ffac1ffad91f None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.055621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c38e74-7334-40ad-9f72-ffac1ffad91f None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.055621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c38e74-7334-40ad-9f72-ffac1ffad91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.075654 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-72c38e74-7334-40ad-9f72-ffac1ffad91f None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:54.076792 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-72c38e74-7334-40ad-9f72-ffac1ffad91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:54.140356 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1396/2792] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:54.149679 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710586d-6dc5-4ea0-b037-9354052820fd None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.150051 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710586d-6dc5-4ea0-b037-9354052820fd None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.150421 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710586d-6dc5-4ea0-b037-9354052820fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.170082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e710586d-6dc5-4ea0-b037-9354052820fd None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:54.171489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e710586d-6dc5-4ea0-b037-9354052820fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:54.181172 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1397/2793] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:54.185511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c38e74-7334-40ad-9f72-ffac1ffad91f None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:54.197168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c38e74-7334-40ad-9f72-ffac1ffad91f None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:54.202675 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae9775-abf3-436b-ab14-a15a7550845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:54.203554 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae9775-abf3-436b-ab14-a15a7550845a admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.203696 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae9775-abf3-436b-ab14-a15a7550845a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.204103 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae9775-abf3-436b-ab14-a15a7550845a admin admin] PATH_INFO: `/v3/domains` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.204844 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae9775-abf3-436b-ab14-a15a7550845a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81054) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:31:54.205537 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae9775-abf3-436b-ab14-a15a7550845a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:54.207169 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae9775-abf3-436b-ab14-a15a7550845a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:54.224008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1397/2794] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:31:54.226168 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710586d-6dc5-4ea0-b037-9354052820fd None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:54.237418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710586d-6dc5-4ea0-b037-9354052820fd None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:54.243030 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98555068-6751-465f-b1c7-46361b38fe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:54.243948 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98555068-6751-465f-b1c7-46361b38fe01 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.244415 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98555068-6751-465f-b1c7-46361b38fe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.244868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98555068-6751-465f-b1c7-46361b38fe01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.245602 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98555068-6751-465f-b1c7-46361b38fe01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:54.247509 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98555068-6751-465f-b1c7-46361b38fe01 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:54.276981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1398/2795] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:31:54 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:31:54.281557 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae9775-abf3-436b-ab14-a15a7550845a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:54.292137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae9775-abf3-436b-ab14-a15a7550845a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:54.371775 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d07b3-c30c-45c3-bf8f-3cec3dc0b4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:54.372788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d07b3-c30c-45c3-bf8f-3cec3dc0b4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.373138 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d07b3-c30c-45c3-bf8f-3cec3dc0b4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.373510 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d07b3-c30c-45c3-bf8f-3cec3dc0b4c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.375820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d07b3-c30c-45c3-bf8f-3cec3dc0b4c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:54.378544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d07b3-c30c-45c3-bf8f-3cec3dc0b4c9 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:54.406476 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1398/2796] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:31:54 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:31:54.407810 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98555068-6751-465f-b1c7-46361b38fe01 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:54.421401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98555068-6751-465f-b1c7-46361b38fe01 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:54.427191 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f151b-07f2-41cc-b412-470758cc7af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:54.427935 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f151b-07f2-41cc-b412-470758cc7af7 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.428214 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f151b-07f2-41cc-b412-470758cc7af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.428551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f151b-07f2-41cc-b412-470758cc7af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.429304 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f151b-07f2-41cc-b412-470758cc7af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:54.431527 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f151b-07f2-41cc-b412-470758cc7af7 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:54.443995 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1399/2797] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:31:54.446945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d07b3-c30c-45c3-bf8f-3cec3dc0b4c9 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:54.457408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d07b3-c30c-45c3-bf8f-3cec3dc0b4c9 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:54.462122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41316245-d249-4624-ab29-dc828327de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:54.462788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41316245-d249-4624-ab29-dc828327de90 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.463076 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41316245-d249-4624-ab29-dc828327de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.463357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41316245-d249-4624-ab29-dc828327de90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.464137 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41316245-d249-4624-ab29-dc828327de90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:54.465742 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41316245-d249-4624-ab29-dc828327de90 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:54.471016 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:54.480078 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1399/2798] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:31:54.482551 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f151b-07f2-41cc-b412-470758cc7af7 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:54.494183 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f151b-07f2-41cc-b412-470758cc7af7 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:54.505360 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b797c4-2f2b-47fe-9b29-ec9910bb0c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:54.506487 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b797c4-2f2b-47fe-9b29-ec9910bb0c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.506780 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b797c4-2f2b-47fe-9b29-ec9910bb0c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.507433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b797c4-2f2b-47fe-9b29-ec9910bb0c4e admin admin] PATH_INFO: `/v3/projects/717393116b6641888a8160ffbbebae34/users/8ef80bd718504406a7a037fd96ce165c/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.525747 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b797c4-2f2b-47fe-9b29-ec9910bb0c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=717393116b6641888a8160ffbbebae34, user_id=8ef80bd718504406a7a037fd96ce165c, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:54.528458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b797c4-2f2b-47fe-9b29-ec9910bb0c4e admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:54.542463 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1400/2799] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:31:54 2022] PUT /identity/v3/projects/717393116b6641888a8160ffbbebae34/users/8ef80bd718504406a7a037fd96ce165c/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:31:54.547489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ed9c9-4a1e-4d95-a656-30dd5c4aba1a None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.547786 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ed9c9-4a1e-4d95-a656-30dd5c4aba1a None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.548152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ed9c9-4a1e-4d95-a656-30dd5c4aba1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.566097 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-386ed9c9-4a1e-4d95-a656-30dd5c4aba1a None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:54.567588 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-386ed9c9-4a1e-4d95-a656-30dd5c4aba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:54.637178 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1400/2800] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:54.651291 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b797c4-2f2b-47fe-9b29-ec9910bb0c4e admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:54.653181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-61b797c4-2f2b-47fe-9b29-ec9910bb0c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:54.723272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b797c4-2f2b-47fe-9b29-ec9910bb0c4e admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:54.729126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5336ad4-077d-4c9d-a171-ffa59c88d892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:54.729813 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336ad4-077d-4c9d-a171-ffa59c88d892 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.730090 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336ad4-077d-4c9d-a171-ffa59c88d892 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.730373 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5336ad4-077d-4c9d-a171-ffa59c88d892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.742846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5336ad4-077d-4c9d-a171-ffa59c88d892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:54.744705 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5336ad4-077d-4c9d-a171-ffa59c88d892 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:54.756760 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1401/2801] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:00.306630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80af8a1-ae53-4b48-9308-3fa21d81faa2 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:00.307205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80af8a1-ae53-4b48-9308-3fa21d81faa2 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:00.307205 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80af8a1-ae53-4b48-9308-3fa21d81faa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:00.343527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-a80af8a1-ae53-4b48-9308-3fa21d81faa2 None None] MFA Rules not processed for user `8ef80bd718504406a7a037fd96ce165c`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:00.345718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-a80af8a1-ae53-4b48-9308-3fa21d81faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:00.422861 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1401/2802] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:00.427513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5336ad4-077d-4c9d-a171-ffa59c88d892 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:00.437486 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5336ad4-077d-4c9d-a171-ffa59c88d892 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:00.442457 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca023f1e-8daf-40c2-9547-0c78248f76ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:00.443122 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023f1e-8daf-40c2-9547-0c78248f76ed admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:00.443538 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023f1e-8daf-40c2-9547-0c78248f76ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:00.444022 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca023f1e-8daf-40c2-9547-0c78248f76ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:00.444910 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca023f1e-8daf-40c2-9547-0c78248f76ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:00.447843 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca023f1e-8daf-40c2-9547-0c78248f76ed admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:00.453758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:00.482954 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1402/2803] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:32:00 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:32:00.487089 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80af8a1-ae53-4b48-9308-3fa21d81faa2 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:00.498554 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80af8a1-ae53-4b48-9308-3fa21d81faa2 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:00.557856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8713e-9545-4295-b8f9-878e0a67cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:00.558438 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8713e-9545-4295-b8f9-878e0a67cdf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:00.558731 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8713e-9545-4295-b8f9-878e0a67cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:00.559017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8713e-9545-4295-b8f9-878e0a67cdf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:00.559715 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8713e-9545-4295-b8f9-878e0a67cdf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:00.561691 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8713e-9545-4295-b8f9-878e0a67cdf3 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:00.583577 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1402/2804] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:32:00 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:32:00.588188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca023f1e-8daf-40c2-9547-0c78248f76ed admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:00.598722 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca023f1e-8daf-40c2-9547-0c78248f76ed admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:00.603428 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06e0c6-f3d9-44a9-8ab9-9f081defc405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:00.604179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06e0c6-f3d9-44a9-8ab9-9f081defc405 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:00.604472 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06e0c6-f3d9-44a9-8ab9-9f081defc405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:00.604755 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06e0c6-f3d9-44a9-8ab9-9f081defc405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:00.605489 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06e0c6-f3d9-44a9-8ab9-9f081defc405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:00.607097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06e0c6-f3d9-44a9-8ab9-9f081defc405 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:00.619099 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1403/2805] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:32:00.623286 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8713e-9545-4295-b8f9-878e0a67cdf3 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:00.634310 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8713e-9545-4295-b8f9-878e0a67cdf3 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:00.639090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed2745-c7e4-436b-94a8-552c53139b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:00.640064 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed2745-c7e4-436b-94a8-552c53139b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:00.640353 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed2745-c7e4-436b-94a8-552c53139b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:00.640631 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed2745-c7e4-436b-94a8-552c53139b9f admin admin] PATH_INFO: `/v3/projects/41ba65d2983043d284dadecc8cf8c95a/users/853f7d82cfc443b1a2681c424e21f8d9/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:00.660531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed2745-c7e4-436b-94a8-552c53139b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ba65d2983043d284dadecc8cf8c95a, user_id=853f7d82cfc443b1a2681c424e21f8d9, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:00.663240 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed2745-c7e4-436b-94a8-552c53139b9f admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:00.666481 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:00.680518 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1403/2806] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:32:00 2022] PUT /identity/v3/projects/41ba65d2983043d284dadecc8cf8c95a/users/853f7d82cfc443b1a2681c424e21f8d9/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:00.684498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06e0c6-f3d9-44a9-8ab9-9f081defc405 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:00.695212 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06e0c6-f3d9-44a9-8ab9-9f081defc405 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:00.761735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58aca6-3af3-4648-8a3b-7c5083b07401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:00.762667 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58aca6-3af3-4648-8a3b-7c5083b07401 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:00.762826 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58aca6-3af3-4648-8a3b-7c5083b07401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:00.763162 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58aca6-3af3-4648-8a3b-7c5083b07401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:00.769367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58aca6-3af3-4648-8a3b-7c5083b07401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:00.773733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58aca6-3af3-4648-8a3b-7c5083b07401 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:00.791986 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1404/2807] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:32:00.793166 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed2745-c7e4-436b-94a8-552c53139b9f admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:00.803560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed2745-c7e4-436b-94a8-552c53139b9f admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:00.810501 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8b1a1-a252-4a8e-abe1-170919d8fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:00.811440 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8b1a1-a252-4a8e-abe1-170919d8fac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:00.811803 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8b1a1-a252-4a8e-abe1-170919d8fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:00.812213 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8b1a1-a252-4a8e-abe1-170919d8fac8 admin admin] PATH_INFO: `/v3/projects/41ba65d2983043d284dadecc8cf8c95a/users/853f7d82cfc443b1a2681c424e21f8d9/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:00.814497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8b1a1-a252-4a8e-abe1-170919d8fac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ba65d2983043d284dadecc8cf8c95a, user_id=853f7d82cfc443b1a2681c424e21f8d9, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:00.817576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8b1a1-a252-4a8e-abe1-170919d8fac8 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:00.835171 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1404/2808] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:32:00 2022] PUT /identity/v3/projects/41ba65d2983043d284dadecc8cf8c95a/users/853f7d82cfc443b1a2681c424e21f8d9/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:06.203424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf110f2e-6c57-4607-bd71-cdfdcd13e89c None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:06.203975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf110f2e-6c57-4607-bd71-cdfdcd13e89c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:06.204291 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf110f2e-6c57-4607-bd71-cdfdcd13e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:06.239468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-cf110f2e-6c57-4607-bd71-cdfdcd13e89c None None] MFA Rules not processed for user `853f7d82cfc443b1a2681c424e21f8d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:06.240748 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-cf110f2e-6c57-4607-bd71-cdfdcd13e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:06.368210 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1405/2809] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:06.384884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8b1a1-a252-4a8e-abe1-170919d8fac8 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:06.388659 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-eae8b1a1-a252-4a8e-abe1-170919d8fac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:06.488125 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8b1a1-a252-4a8e-abe1-170919d8fac8 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:06.495806 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68a1d5-3f15-4fcb-a61d-4546de55301b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ee61aece9c64e74806248e4ac49cd47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:06.496527 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68a1d5-3f15-4fcb-a61d-4546de55301b service glance] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:06.496866 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68a1d5-3f15-4fcb-a61d-4546de55301b service glance] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:06.497154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68a1d5-3f15-4fcb-a61d-4546de55301b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:06.563883 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68a1d5-3f15-4fcb-a61d-4546de55301b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:06.565445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68a1d5-3f15-4fcb-a61d-4546de55301b service glance] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:06.575576 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1405/2810] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:06.695278 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da5a1e-3526-4423-90f0-7865d634a917 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:06.695574 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da5a1e-3526-4423-90f0-7865d634a917 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:06.695925 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da5a1e-3526-4423-90f0-7865d634a917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:06.717096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-d4da5a1e-3526-4423-90f0-7865d634a917 None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:06.718670 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d4da5a1e-3526-4423-90f0-7865d634a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:06.794506 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1406/2811] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:32:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:06.866247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68a1d5-3f15-4fcb-a61d-4546de55301b service glance] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:06.867657 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-3f68a1d5-3f15-4fcb-a61d-4546de55301b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:06.940946 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68a1d5-3f15-4fcb-a61d-4546de55301b service glance] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:06.946131 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce0a0d-d787-4d29-a0b5-86a86dd64827 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:06.946778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce0a0d-d787-4d29-a0b5-86a86dd64827 service swift] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:06.947060 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce0a0d-d787-4d29-a0b5-86a86dd64827 service swift] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:06.947336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce0a0d-d787-4d29-a0b5-86a86dd64827 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:06.955194 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce0a0d-d787-4d29-a0b5-86a86dd64827 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:06.956813 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce0a0d-d787-4d29-a0b5-86a86dd64827 service swift] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:06.965235 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1406/2812] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:32:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:10.473638 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af859-150b-41e1-b919-60137642bfbb None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:10.474641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af859-150b-41e1-b919-60137642bfbb None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:10.475522 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af859-150b-41e1-b919-60137642bfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:10.486661 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:10.508290 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-b68af859-150b-41e1-b919-60137642bfbb None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:10.510146 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b68af859-150b-41e1-b919-60137642bfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:10.519595 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1407/2813] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:32:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:10.541154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce0a0d-d787-4d29-a0b5-86a86dd64827 service swift] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:10.554784 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce0a0d-d787-4d29-a0b5-86a86dd64827 service swift] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:10.562439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0068c-7219-4bc3-9f2d-1c309c65a73a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:10.563099 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0068c-7219-4bc3-9f2d-1c309c65a73a service swift] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:10.563388 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0068c-7219-4bc3-9f2d-1c309c65a73a service swift] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:10.563670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0068c-7219-4bc3-9f2d-1c309c65a73a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:10.574051 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0068c-7219-4bc3-9f2d-1c309c65a73a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:10.576122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0068c-7219-4bc3-9f2d-1c309c65a73a service swift] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:10.587389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1407/2814] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:32:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:10.684357 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68af859-150b-41e1-b919-60137642bfbb None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:10.685786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-b68af859-150b-41e1-b919-60137642bfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:10.768471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68af859-150b-41e1-b919-60137642bfbb None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:10.773915 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:10.775029 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:10.775879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:10.775879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] PATH_INFO: `/v3/users/799e1189c83b40588fe5e2d84af3ae96` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:10.776881 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=799e1189c83b40588fe5e2d84af3ae96)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:10.779167 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:10.867197 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799e1189c83b40588fe5e2d84af3ae96'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:10.868593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799e1189c83b40588fe5e2d84af3ae96'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:10.885979 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799e1189c83b40588fe5e2d84af3ae96'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:10.886719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799e1189c83b40588fe5e2d84af3ae96'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:10.895474 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799e1189c83b40588fe5e2d84af3ae96'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:10.928079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1408/2815] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:32:10 2022] DELETE /identity/v3/users/799e1189c83b40588fe5e2d84af3ae96 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:10.932931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4816-d44d-4607-9542-462e2a80119e None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:10.933227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4816-d44d-4607-9542-462e2a80119e None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:10.933513 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce4816-d44d-4607-9542-462e2a80119e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:10.953224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-83ce4816-d44d-4607-9542-462e2a80119e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:10.954443 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-83ce4816-d44d-4607-9542-462e2a80119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:10.969488 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:11.049248 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1408/2816] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:11.058076 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:11.059685 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:11.136984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44dfe2-fd03-4118-be35-cf560e82ad49 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:11.140960 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a316b-5de9-487a-8139-63e126e00328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:11.141728 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a316b-5de9-487a-8139-63e126e00328 service neutron] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:11.142015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a316b-5de9-487a-8139-63e126e00328 service neutron] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:11.142293 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a316b-5de9-487a-8139-63e126e00328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:11.156690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a316b-5de9-487a-8139-63e126e00328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:11.156690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a316b-5de9-487a-8139-63e126e00328 service neutron] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:11.167229 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1409/2817] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:11.263403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396caeff-7c36-4313-b0b6-1b2cb3d5830c None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:11.263782 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396caeff-7c36-4313-b0b6-1b2cb3d5830c None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:11.264283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396caeff-7c36-4313-b0b6-1b2cb3d5830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:11.308822 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-396caeff-7c36-4313-b0b6-1b2cb3d5830c None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:11.310065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-396caeff-7c36-4313-b0b6-1b2cb3d5830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:11.419142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1409/2818] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 16 00:32:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:11.437392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a316b-5de9-487a-8139-63e126e00328 service neutron] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:11.438849 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-bb3a316b-5de9-487a-8139-63e126e00328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:11.467588 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:11.548489 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396caeff-7c36-4313-b0b6-1b2cb3d5830c None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:11.550627 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-396caeff-7c36-4313-b0b6-1b2cb3d5830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:11.567511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a316b-5de9-487a-8139-63e126e00328 service neutron] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:11.574023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4654201-2c98-452e-a63d-4a819a78cde1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:11.574692 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654201-2c98-452e-a63d-4a819a78cde1 service swift] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:11.574981 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654201-2c98-452e-a63d-4a819a78cde1 service swift] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:11.575260 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4654201-2c98-452e-a63d-4a819a78cde1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:11.580462 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396caeff-7c36-4313-b0b6-1b2cb3d5830c None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:11.591453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654201-2c98-452e-a63d-4a819a78cde1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:11.592668 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:11.594261 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:11.594555 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:11.594837 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] PATH_INFO: `/v3/projects/594f8bfb9bd24db9af5a00a7371bdbd6` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:11.596253 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4654201-2c98-452e-a63d-4a819a78cde1 service swift] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:11.601392 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594f8bfb9bd24db9af5a00a7371bdbd6)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:11.603466 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:11.614833 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1410/2819] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:32:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:11.699418 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594f8bfb9bd24db9af5a00a7371bdbd6', 'request_id': 'req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:11.713431 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594f8bfb9bd24db9af5a00a7371bdbd6', 'request_id': 'req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:11.723374 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594f8bfb9bd24db9af5a00a7371bdbd6', 'request_id': 'req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:11.740442 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] The token cache is being invalidate because project 594f8bfb9bd24db9af5a00a7371bdbd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:32:11.740945 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:11.741802 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-ea5d1a6e-69cc-4b39-81b6-212cac28ce98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:11.747403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1410/2820] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:32:11 2022] DELETE /identity/v3/projects/594f8bfb9bd24db9af5a00a7371bdbd6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:32:11.750171 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592abd-11ce-4137-9119-2e0fb85659e0 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:11.750656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592abd-11ce-4137-9119-2e0fb85659e0 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:11.751044 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62592abd-11ce-4137-9119-2e0fb85659e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:11.785011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-62592abd-11ce-4137-9119-2e0fb85659e0 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:11.786528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-62592abd-11ce-4137-9119-2e0fb85659e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:11.921977 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1411/2821] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:11.924664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef5e3-b492-45e2-8c9a-ae250cdfa86d None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:11.924962 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef5e3-b492-45e2-8c9a-ae250cdfa86d None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:11.925249 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef5e3-b492-45e2-8c9a-ae250cdfa86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:11.952072 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-439ef5e3-b492-45e2-8c9a-ae250cdfa86d None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:11.953408 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-439ef5e3-b492-45e2-8c9a-ae250cdfa86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:11.968022 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1411/2822] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:11.972338 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62592abd-11ce-4137-9119-2e0fb85659e0 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:11.982619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62592abd-11ce-4137-9119-2e0fb85659e0 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:11.989423 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c15db-b3ff-4a1a-9463-81817874219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:11.989678 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c15db-b3ff-4a1a-9463-81817874219d admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:11.989815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c15db-b3ff-4a1a-9463-81817874219d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:11.990107 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c15db-b3ff-4a1a-9463-81817874219d admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:11.990850 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c15db-b3ff-4a1a-9463-81817874219d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:32:11.991180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c15db-b3ff-4a1a-9463-81817874219d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:11.993446 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c15db-b3ff-4a1a-9463-81817874219d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.013289 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef5e3-b492-45e2-8c9a-ae250cdfa86d None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.028000 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef5e3-b492-45e2-8c9a-ae250cdfa86d None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.028204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1412/2823] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:32:12.033752 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c7245-9401-49da-a23e-5b901e70d25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:12.034432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c7245-9401-49da-a23e-5b901e70d25e admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.034719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c7245-9401-49da-a23e-5b901e70d25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.034999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c7245-9401-49da-a23e-5b901e70d25e admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.035716 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c7245-9401-49da-a23e-5b901e70d25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:12.037690 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c7245-9401-49da-a23e-5b901e70d25e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.084091 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa658c-f94b-43ff-9c83-1b16f99ca9d3 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.084587 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa658c-f94b-43ff-9c83-1b16f99ca9d3 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.084984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa658c-f94b-43ff-9c83-1b16f99ca9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.085590 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1412/2824] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:32:12 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:32:12.089708 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c7245-9401-49da-a23e-5b901e70d25e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.107384 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:12.118975 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-97aa658c-f94b-43ff-9c83-1b16f99ca9d3 None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:12.121158 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-97aa658c-f94b-43ff-9c83-1b16f99ca9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:12.176252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c7245-9401-49da-a23e-5b901e70d25e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.181428 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aec19-b5ea-498b-a44c-1c8d60e7be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:12.182110 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aec19-b5ea-498b-a44c-1c8d60e7be27 admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.182393 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aec19-b5ea-498b-a44c-1c8d60e7be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.182844 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aec19-b5ea-498b-a44c-1c8d60e7be27 admin admin] PATH_INFO: `/v3/users` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.183545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aec19-b5ea-498b-a44c-1c8d60e7be27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:12.185642 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aec19-b5ea-498b-a44c-1c8d60e7be27 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.201656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1413/2825] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:32:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:12.218764 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa658c-f94b-43ff-9c83-1b16f99ca9d3 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.219116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1413/2826] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:32:12 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:32:12.220296 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-97aa658c-f94b-43ff-9c83-1b16f99ca9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:12.224467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aec19-b5ea-498b-a44c-1c8d60e7be27 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.235070 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aec19-b5ea-498b-a44c-1c8d60e7be27 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.240925 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836a5f6-2c2a-4487-8eaa-591c6cac0429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:12.241788 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836a5f6-2c2a-4487-8eaa-591c6cac0429 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.242175 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836a5f6-2c2a-4487-8eaa-591c6cac0429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.242670 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836a5f6-2c2a-4487-8eaa-591c6cac0429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.243376 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836a5f6-2c2a-4487-8eaa-591c6cac0429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:12.245101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836a5f6-2c2a-4487-8eaa-591c6cac0429 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.259770 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1414/2827] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:32:12.263465 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836a5f6-2c2a-4487-8eaa-591c6cac0429 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.276024 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836a5f6-2c2a-4487-8eaa-591c6cac0429 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.278701 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=100 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:12.281405 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d8ee9-87fa-4095-8537-195ec9a0c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:12.282203 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8ee9-87fa-4095-8537-195ec9a0c5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.282490 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8ee9-87fa-4095-8537-195ec9a0c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.282812 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8ee9-87fa-4095-8537-195ec9a0c5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.283741 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d8ee9-87fa-4095-8537-195ec9a0c5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:12.286040 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d8ee9-87fa-4095-8537-195ec9a0c5c4 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.300514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1415/2828] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:32:12.304780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d8ee9-87fa-4095-8537-195ec9a0c5c4 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.314184 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa658c-f94b-43ff-9c83-1b16f99ca9d3 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.315313 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d8ee9-87fa-4095-8537-195ec9a0c5c4 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.320644 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc709d-533c-40d1-a3c4-09d78aea63f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:12.321251 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be9154-5e2d-4738-b0f3-2bbb157b5476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:12.321383 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc709d-533c-40d1-a3c4-09d78aea63f5 service swift] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.321584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc709d-533c-40d1-a3c4-09d78aea63f5 service swift] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.321868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc709d-533c-40d1-a3c4-09d78aea63f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.322183 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be9154-5e2d-4738-b0f3-2bbb157b5476 admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.322566 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be9154-5e2d-4738-b0f3-2bbb157b5476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.322865 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be9154-5e2d-4738-b0f3-2bbb157b5476 admin admin] PATH_INFO: `/v3/projects/c6a582f7fa444943b58db7513f044ebe/users/7726adfe4fc844cc9c4e5d3d8cbd4323/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.331769 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc709d-533c-40d1-a3c4-09d78aea63f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:12.335005 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc709d-533c-40d1-a3c4-09d78aea63f5 service swift] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.341922 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be9154-5e2d-4738-b0f3-2bbb157b5476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a582f7fa444943b58db7513f044ebe, user_id=7726adfe4fc844cc9c4e5d3d8cbd4323, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:12.345137 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1414/2829] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:32:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:32:12.345263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be9154-5e2d-4738-b0f3-2bbb157b5476 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.362921 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1416/2830] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:32:12 2022] PUT /identity/v3/projects/c6a582f7fa444943b58db7513f044ebe/users/7726adfe4fc844cc9c4e5d3d8cbd4323/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:32:12.376096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704e1d0-fb73-41f3-8c13-0f51f8e283b6 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.376401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704e1d0-fb73-41f3-8c13-0f51f8e283b6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.376740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704e1d0-fb73-41f3-8c13-0f51f8e283b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.421341 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-5704e1d0-fb73-41f3-8c13-0f51f8e283b6 None None] MFA Rules not processed for user `7726adfe4fc844cc9c4e5d3d8cbd4323`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:12.422574 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5704e1d0-fb73-41f3-8c13-0f51f8e283b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:12.520908 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be9154-5e2d-4738-b0f3-2bbb157b5476 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.526418 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1415/2831] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:12.620430 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be9154-5e2d-4738-b0f3-2bbb157b5476 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.636246 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2787a-826b-4f9e-8344-8debd39987ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:12.637229 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2787a-826b-4f9e-8344-8debd39987ee admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.637521 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2787a-826b-4f9e-8344-8debd39987ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.637809 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2787a-826b-4f9e-8344-8debd39987ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.638529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2787a-826b-4f9e-8344-8debd39987ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:12.640515 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2787a-826b-4f9e-8344-8debd39987ee admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.680472 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1417/2832] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:32:12 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:32:12.684475 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704e1d0-fb73-41f3-8c13-0f51f8e283b6 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.700294 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704e1d0-fb73-41f3-8c13-0f51f8e283b6 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.798101 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91347911-6416-407c-86e3-5ed10a3eac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:12.798792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347911-6416-407c-86e3-5ed10a3eac82 admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.799056 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347911-6416-407c-86e3-5ed10a3eac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.799334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91347911-6416-407c-86e3-5ed10a3eac82 admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.800106 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91347911-6416-407c-86e3-5ed10a3eac82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:12.802020 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91347911-6416-407c-86e3-5ed10a3eac82 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.829601 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1416/2833] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:32:12 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:32:12.833525 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2787a-826b-4f9e-8344-8debd39987ee admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.846109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85773a0b-7d11-420a-8676-662047144465 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.846403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85773a0b-7d11-420a-8676-662047144465 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.846757 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85773a0b-7d11-420a-8676-662047144465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.848619 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2787a-826b-4f9e-8344-8debd39987ee admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.859584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73911718-1096-4b55-bb20-260671ddcb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:12.860389 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73911718-1096-4b55-bb20-260671ddcb1a admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.860774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73911718-1096-4b55-bb20-260671ddcb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.861151 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73911718-1096-4b55-bb20-260671ddcb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.861991 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73911718-1096-4b55-bb20-260671ddcb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:12.865419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73911718-1096-4b55-bb20-260671ddcb1a admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.868403 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-85773a0b-7d11-420a-8676-662047144465 None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:12.870395 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-85773a0b-7d11-420a-8676-662047144465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:12.883336 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1418/2834] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:32:12.884662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73911718-1096-4b55-bb20-260671ddcb1a admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.896854 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73911718-1096-4b55-bb20-260671ddcb1a admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.905630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd15eb-40fa-4817-a23a-ea9839861f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:12.906748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd15eb-40fa-4817-a23a-ea9839861f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:12.907153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd15eb-40fa-4817-a23a-ea9839861f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:12.907778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd15eb-40fa-4817-a23a-ea9839861f1d admin admin] PATH_INFO: `/v3/projects/b7fa3b9fe02845e79b7d0db037366c3d/users/ad7bc3d9eff0482a90434e63bb4cce44/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:12.927085 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:12.930763 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd15eb-40fa-4817-a23a-ea9839861f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fa3b9fe02845e79b7d0db037366c3d, user_id=ad7bc3d9eff0482a90434e63bb4cce44, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:12.934144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd15eb-40fa-4817-a23a-ea9839861f1d admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:12.942458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1417/2835] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 16 00:32:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:12.952779 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1419/2836] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:32:12 2022] PUT /identity/v3/projects/b7fa3b9fe02845e79b7d0db037366c3d/users/ad7bc3d9eff0482a90434e63bb4cce44/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:12.956436 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85773a0b-7d11-420a-8676-662047144465 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.959026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd15eb-40fa-4817-a23a-ea9839861f1d admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:12.969716 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85773a0b-7d11-420a-8676-662047144465 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:12.970821 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:13.046481 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e90f0b-5524-4043-b59f-e643cf4746f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:13.047252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e90f0b-5524-4043-b59f-e643cf4746f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:13.047784 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e90f0b-5524-4043-b59f-e643cf4746f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:13.048164 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e90f0b-5524-4043-b59f-e643cf4746f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:13.049830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e90f0b-5524-4043-b59f-e643cf4746f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:13.051767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e90f0b-5524-4043-b59f-e643cf4746f9 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:13.054912 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd15eb-40fa-4817-a23a-ea9839861f1d admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:13.064257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf69bbc-57ac-4489-bf2f-1bdd33fe2fb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:13.065414 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69bbc-57ac-4489-bf2f-1bdd33fe2fb5 service swift] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:13.065561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1418/2837] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:32:13.065826 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69bbc-57ac-4489-bf2f-1bdd33fe2fb5 service swift] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:13.066176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69bbc-57ac-4489-bf2f-1bdd33fe2fb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:13.070369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e90f0b-5524-4043-b59f-e643cf4746f9 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:13.081432 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e90f0b-5524-4043-b59f-e643cf4746f9 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:13.089320 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e2788-26e7-44d4-a8c2-ea49a9f98ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:13.090322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e2788-26e7-44d4-a8c2-ea49a9f98ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:13.090689 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e2788-26e7-44d4-a8c2-ea49a9f98ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:13.091045 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e2788-26e7-44d4-a8c2-ea49a9f98ef8 admin admin] PATH_INFO: `/v3/projects/b7fa3b9fe02845e79b7d0db037366c3d/users/ad7bc3d9eff0482a90434e63bb4cce44/roles/9eb6a7e444724b218f6b26eb4ec234c2` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:13.093306 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e2788-26e7-44d4-a8c2-ea49a9f98ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fa3b9fe02845e79b7d0db037366c3d, user_id=ad7bc3d9eff0482a90434e63bb4cce44, role_id=9eb6a7e444724b218f6b26eb4ec234c2)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:13.096356 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e2788-26e7-44d4-a8c2-ea49a9f98ef8 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:13.117961 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1419/2838] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:32:13 2022] PUT /identity/v3/projects/b7fa3b9fe02845e79b7d0db037366c3d/users/ad7bc3d9eff0482a90434e63bb4cce44/roles/9eb6a7e444724b218f6b26eb4ec234c2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:13.122549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252e82-b3c5-4ae4-820f-582a43d7cca0 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:13.122705 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252e82-b3c5-4ae4-820f-582a43d7cca0 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:13.123064 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252e82-b3c5-4ae4-820f-582a43d7cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:13.141412 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf69bbc-57ac-4489-bf2f-1bdd33fe2fb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:13.143148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf69bbc-57ac-4489-bf2f-1bdd33fe2fb5 service swift] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:13.152345 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1420/2839] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:32:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:32:13.154879 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-5b252e82-b3c5-4ae4-820f-582a43d7cca0 None None] MFA Rules not processed for user `ad7bc3d9eff0482a90434e63bb4cce44`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:13.156398 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5b252e82-b3c5-4ae4-820f-582a43d7cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:13.285845 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1420/2840] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:13.298545 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf69bbc-57ac-4489-bf2f-1bdd33fe2fb5 service swift] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:13.300107 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9bf69bbc-57ac-4489-bf2f-1bdd33fe2fb5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:13.396202 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf69bbc-57ac-4489-bf2f-1bdd33fe2fb5 service swift] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:13.470139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd470226-1ae4-4796-b60c-652bb5a53137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:13.470814 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd470226-1ae4-4796-b60c-652bb5a53137 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:13.471101 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd470226-1ae4-4796-b60c-652bb5a53137 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:13.471383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd470226-1ae4-4796-b60c-652bb5a53137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:13.494695 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=100 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:13.570769 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd470226-1ae4-4796-b60c-652bb5a53137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:13.572283 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd470226-1ae4-4796-b60c-652bb5a53137 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:13.585780 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1421/2841] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:15.191134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b252e82-b3c5-4ae4-820f-582a43d7cca0 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:15.194173 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-5b252e82-b3c5-4ae4-820f-582a43d7cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:15.311104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:15.338105 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b252e82-b3c5-4ae4-820f-582a43d7cca0 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:15.348321 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342e0bc-652d-4dbf-b42c-ae7befa086f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:15.349153 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342e0bc-652d-4dbf-b42c-ae7befa086f5 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:15.349452 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342e0bc-652d-4dbf-b42c-ae7befa086f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:15.349733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342e0bc-652d-4dbf-b42c-ae7befa086f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:15.352392 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-7342e0bc-652d-4dbf-b42c-ae7befa086f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:15.375177 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342e0bc-652d-4dbf-b42c-ae7befa086f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:15.377536 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342e0bc-652d-4dbf-b42c-ae7befa086f5 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:15.406408 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1421/2842] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:15.613027 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd470226-1ae4-4796-b60c-652bb5a53137 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:15.614905 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-dd470226-1ae4-4796-b60c-652bb5a53137 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:15.698929 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd470226-1ae4-4796-b60c-652bb5a53137 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:15.709313 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:15.711132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:15.711609 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:15.712390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] PATH_INFO: `/v3/users/2b84e5d2bf0947619bc073f85e1f38b3` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:15.713800 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b84e5d2bf0947619bc073f85e1f38b3)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:15.716087 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:15.779114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b84e5d2bf0947619bc073f85e1f38b3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:15.796895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b84e5d2bf0947619bc073f85e1f38b3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:15.797931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b84e5d2bf0947619bc073f85e1f38b3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:15.811079 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b84e5d2bf0947619bc073f85e1f38b3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:15.823057 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b84e5d2bf0947619bc073f85e1f38b3'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:15.830564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1422/2843] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:32:15 2022] DELETE /identity/v3/users/2b84e5d2bf0947619bc073f85e1f38b3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:15.835486 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0106fb3-8e5a-4d42-a71f-5fbfddcac12e None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:15.835814 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0106fb3-8e5a-4d42-a71f-5fbfddcac12e None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:15.836301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0106fb3-8e5a-4d42-a71f-5fbfddcac12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:15.857859 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c0106fb3-8e5a-4d42-a71f-5fbfddcac12e None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:15.859097 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c0106fb3-8e5a-4d42-a71f-5fbfddcac12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:15.952561 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1422/2844] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:15.963992 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:15.965459 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:16.034897 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:16.060323 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346087c-1d48-4805-bef6-6776ef4f2947 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:16.076090 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679d54c-82b5-4236-b0fd-42d9a9793031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:16.076856 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679d54c-82b5-4236-b0fd-42d9a9793031 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:16.077144 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679d54c-82b5-4236-b0fd-42d9a9793031 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:16.077420 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679d54c-82b5-4236-b0fd-42d9a9793031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:16.091550 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679d54c-82b5-4236-b0fd-42d9a9793031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:16.093247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679d54c-82b5-4236-b0fd-42d9a9793031 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:16.106132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1423/2845] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:16.329233 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0106fb3-8e5a-4d42-a71f-5fbfddcac12e None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:16.331406 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c0106fb3-8e5a-4d42-a71f-5fbfddcac12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:16.346122 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679d54c-82b5-4236-b0fd-42d9a9793031 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:16.347247 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8679d54c-82b5-4236-b0fd-42d9a9793031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:16.356690 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0106fb3-8e5a-4d42-a71f-5fbfddcac12e None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:16.364706 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679d54c-82b5-4236-b0fd-42d9a9793031 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:16.370848 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:16.379779 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:16.381064 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:16.381351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:16.381627 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] PATH_INFO: `/v3/projects/b7432aad587d49f5a2d6bced6ba847b8` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:16.383936 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:16.384494 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7432aad587d49f5a2d6bced6ba847b8)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:16.384903 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:16.385296 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] PATH_INFO: `/v3/users/7726adfe4fc844cc9c4e5d3d8cbd4323` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:16.386987 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:16.387621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7726adfe4fc844cc9c4e5d3d8cbd4323)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:16.390148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:16.452796 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7432aad587d49f5a2d6bced6ba847b8', 'request_id': 'req-89198227-968b-41ad-996b-1c2a584c5f9f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:16.459789 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7726adfe4fc844cc9c4e5d3d8cbd4323'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:16.463836 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7432aad587d49f5a2d6bced6ba847b8', 'request_id': 'req-89198227-968b-41ad-996b-1c2a584c5f9f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:16.474655 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7432aad587d49f5a2d6bced6ba847b8', 'request_id': 'req-89198227-968b-41ad-996b-1c2a584c5f9f'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:16.477542 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7726adfe4fc844cc9c4e5d3d8cbd4323'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:16.478143 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7726adfe4fc844cc9c4e5d3d8cbd4323'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:16.489470 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7726adfe4fc844cc9c4e5d3d8cbd4323'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:16.489815 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] The token cache is being invalidate because project b7432aad587d49f5a2d6bced6ba847b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:32:16.490073 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:16.490841 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-89198227-968b-41ad-996b-1c2a584c5f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:16.498553 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1423/2846] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:32:16 2022] DELETE /identity/v3/projects/b7432aad587d49f5a2d6bced6ba847b8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:16.498731 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7726adfe4fc844cc9c4e5d3d8cbd4323'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:16.519817 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1424/2847] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:32:16 2022] DELETE /identity/v3/users/7726adfe4fc844cc9c4e5d3d8cbd4323 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:32:16.525892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33c49-e54f-41bc-a39c-dc987102239b None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:16.526181 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33c49-e54f-41bc-a39c-dc987102239b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:16.526461 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe33c49-e54f-41bc-a39c-dc987102239b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:16.564363 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-efe33c49-e54f-41bc-a39c-dc987102239b None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:16.565925 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-efe33c49-e54f-41bc-a39c-dc987102239b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:16.677830 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:16.679126 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1424/2848] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:16.680729 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:16.818391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e408a3-00ca-45b3-bf95-8c040eb6a014 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:16.856745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d991506-49e8-4f3b-ad94-9bd6bfcfc18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:16.857565 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d991506-49e8-4f3b-ad94-9bd6bfcfc18c service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:16.857955 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d991506-49e8-4f3b-ad94-9bd6bfcfc18c service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:16.858335 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d991506-49e8-4f3b-ad94-9bd6bfcfc18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:16.881026 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d991506-49e8-4f3b-ad94-9bd6bfcfc18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:16.882990 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d991506-49e8-4f3b-ad94-9bd6bfcfc18c service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:16.912842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1425/2849] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:32:17.295420 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe33c49-e54f-41bc-a39c-dc987102239b None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:17.297103 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-efe33c49-e54f-41bc-a39c-dc987102239b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:17.317330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe33c49-e54f-41bc-a39c-dc987102239b None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:17.324880 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:17.326196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:17.326672 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:17.327142 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] PATH_INFO: `/v3/projects/c6a582f7fa444943b58db7513f044ebe` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:17.329396 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6a582f7fa444943b58db7513f044ebe)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:17.342719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:17.356204 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:17.409387 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6a582f7fa444943b58db7513f044ebe', 'request_id': 'req-02b9d244-caa7-4297-bdf8-ae2960dc0b80'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:17.420317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6a582f7fa444943b58db7513f044ebe', 'request_id': 'req-02b9d244-caa7-4297-bdf8-ae2960dc0b80'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:17.430185 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6a582f7fa444943b58db7513f044ebe', 'request_id': 'req-02b9d244-caa7-4297-bdf8-ae2960dc0b80'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:17.443196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] The token cache is being invalidate because project c6a582f7fa444943b58db7513f044ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:32:17.443196 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:17.443929 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:17.448891 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1425/2850] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:32:17 2022] DELETE /identity/v3/projects/c6a582f7fa444943b58db7513f044ebe => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:32:17.449985 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d991506-49e8-4f3b-ad94-9bd6bfcfc18c service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:17.469065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d991506-49e8-4f3b-ad94-9bd6bfcfc18c service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:17.547537 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:17.560160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d52df-1ebe-4378-b189-22c995470927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:17.562252 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d52df-1ebe-4378-b189-22c995470927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:17.562890 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d52df-1ebe-4378-b189-22c995470927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:17.563508 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d52df-1ebe-4378-b189-22c995470927 admin admin] PATH_INFO: `/v3/users/ad7bc3d9eff0482a90434e63bb4cce44` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:17.565667 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d52df-1ebe-4378-b189-22c995470927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7bc3d9eff0482a90434e63bb4cce44)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:17.568265 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d52df-1ebe-4378-b189-22c995470927 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:17.635453 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f29d52df-1ebe-4378-b189-22c995470927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7bc3d9eff0482a90434e63bb4cce44'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:17.654170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f29d52df-1ebe-4378-b189-22c995470927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7bc3d9eff0482a90434e63bb4cce44'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:17.655763 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f29d52df-1ebe-4378-b189-22c995470927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7bc3d9eff0482a90434e63bb4cce44'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:17.671176 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f29d52df-1ebe-4378-b189-22c995470927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7bc3d9eff0482a90434e63bb4cce44'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:17.680200 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-f29d52df-1ebe-4378-b189-22c995470927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7bc3d9eff0482a90434e63bb4cce44'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:17.687139 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1426/2851] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:32:17 2022] DELETE /identity/v3/users/ad7bc3d9eff0482a90434e63bb4cce44 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:32:18.064244 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:18.065774 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:18.087266 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9d244-caa7-4297-bdf8-ae2960dc0b80 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:18.170169 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:18.170541 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9a383-2cdf-49f5-82d4-072eb2391a6b None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.170845 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9a383-2cdf-49f5-82d4-072eb2391a6b None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.171132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9a383-2cdf-49f5-82d4-072eb2391a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.172080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.172549 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.173008 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] PATH_INFO: `/v3/projects/b7fa3b9fe02845e79b7d0db037366c3d` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.174528 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fa3b9fe02845e79b7d0db037366c3d)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:18.176523 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:18.191033 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-c2a9a383-2cdf-49f5-82d4-072eb2391a6b None None] MFA Rules not processed for user `8ef80bd718504406a7a037fd96ce165c`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:18.192726 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c2a9a383-2cdf-49f5-82d4-072eb2391a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:18.239577 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fa3b9fe02845e79b7d0db037366c3d', 'request_id': 'req-8a8325ed-48bd-48c9-ad1b-2ce481106964'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:18.251072 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fa3b9fe02845e79b7d0db037366c3d', 'request_id': 'req-8a8325ed-48bd-48c9-ad1b-2ce481106964'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:18.258735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fa3b9fe02845e79b7d0db037366c3d', 'request_id': 'req-8a8325ed-48bd-48c9-ad1b-2ce481106964'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:18.271495 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] The token cache is being invalidate because project b7fa3b9fe02845e79b7d0db037366c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:32:18.271799 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:18.272792 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-8a8325ed-48bd-48c9-ad1b-2ce481106964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:18.277738 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1426/2852] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:32:18 2022] DELETE /identity/v3/projects/b7fa3b9fe02845e79b7d0db037366c3d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:18.278132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1427/2853] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:18.280004 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeba6a-7d7a-4cc0-8dc9-d3e31d7be951 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.280188 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeba6a-7d7a-4cc0-8dc9-d3e31d7be951 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.280468 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeba6a-7d7a-4cc0-8dc9-d3e31d7be951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.307255 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-feeeba6a-7d7a-4cc0-8dc9-d3e31d7be951 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:18.308942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-feeeba6a-7d7a-4cc0-8dc9-d3e31d7be951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:18.339437 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:18.389272 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1427/2854] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:18.398199 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4305ba-1288-48cb-92f5-cc620aab2cf1 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.398548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4305ba-1288-48cb-92f5-cc620aab2cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.398778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4305ba-1288-48cb-92f5-cc620aab2cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.417539 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-1a4305ba-1288-48cb-92f5-cc620aab2cf1 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:18.418766 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-1a4305ba-1288-48cb-92f5-cc620aab2cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:18.426895 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1428/2855] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:18.431763 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeba6a-7d7a-4cc0-8dc9-d3e31d7be951 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:18.441646 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeba6a-7d7a-4cc0-8dc9-d3e31d7be951 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:18.447565 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03286f-d7d1-4d87-98a5-cbc8079d1aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:18.448257 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03286f-d7d1-4d87-98a5-cbc8079d1aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.448544 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03286f-d7d1-4d87-98a5-cbc8079d1aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.448819 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03286f-d7d1-4d87-98a5-cbc8079d1aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.449540 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03286f-d7d1-4d87-98a5-cbc8079d1aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81055) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:32:18.449858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03286f-d7d1-4d87-98a5-cbc8079d1aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:18.451434 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03286f-d7d1-4d87-98a5-cbc8079d1aa8 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:18.464087 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1428/2856] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 16 00:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:32:18.468298 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4305ba-1288-48cb-92f5-cc620aab2cf1 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:18.478153 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4305ba-1288-48cb-92f5-cc620aab2cf1 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:18.483857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fe762-1af6-4271-84b0-08408b7b08cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:18.485053 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fe762-1af6-4271-84b0-08408b7b08cb admin admin] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.485505 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fe762-1af6-4271-84b0-08408b7b08cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.485947 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fe762-1af6-4271-84b0-08408b7b08cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.486820 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fe762-1af6-4271-84b0-08408b7b08cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:18.489059 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fe762-1af6-4271-84b0-08408b7b08cb admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:18.518731 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1429/2857] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 16 00:32:18 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:32:18.520240 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03286f-d7d1-4d87-98a5-cbc8079d1aa8 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:18.531289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03286f-d7d1-4d87-98a5-cbc8079d1aa8 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:18.595656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e751b94-7439-4f07-9911-a47cfb65089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:18.596435 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e751b94-7439-4f07-9911-a47cfb65089a admin admin] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.596731 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e751b94-7439-4f07-9911-a47cfb65089a admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.597023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e751b94-7439-4f07-9911-a47cfb65089a admin admin] PATH_INFO: `/v3/users` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.597733 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e751b94-7439-4f07-9911-a47cfb65089a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:18.599671 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e751b94-7439-4f07-9911-a47cfb65089a admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:18.626339 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1429/2858] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 16 00:32:18 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:32:18.631198 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fe762-1af6-4271-84b0-08408b7b08cb admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:18.643748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fe762-1af6-4271-84b0-08408b7b08cb admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:18.649973 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67894e-919b-48a9-8e19-ae0d9c58b904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:18.650839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67894e-919b-48a9-8e19-ae0d9c58b904 admin admin] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.651307 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67894e-919b-48a9-8e19-ae0d9c58b904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.651914 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67894e-919b-48a9-8e19-ae0d9c58b904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.652878 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67894e-919b-48a9-8e19-ae0d9c58b904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:18.654738 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67894e-919b-48a9-8e19-ae0d9c58b904 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:18.666595 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1430/2859] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:32:18.670721 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e751b94-7439-4f07-9911-a47cfb65089a admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:18.683155 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e751b94-7439-4f07-9911-a47cfb65089a admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:18.688797 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ef75f-6ee1-4516-901b-c52b769fbb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:18.689652 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef75f-6ee1-4516-901b-c52b769fbb0d admin admin] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.690046 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef75f-6ee1-4516-901b-c52b769fbb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.690340 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef75f-6ee1-4516-901b-c52b769fbb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.691079 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ef75f-6ee1-4516-901b-c52b769fbb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:18.692985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ef75f-6ee1-4516-901b-c52b769fbb0d admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:18.707134 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1430/2860] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 16 00:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:32:18.708659 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67894e-919b-48a9-8e19-ae0d9c58b904 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:18.719979 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67894e-919b-48a9-8e19-ae0d9c58b904 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:18.724575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a7b3-e41b-4f99-867d-5f4143ed8d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:18.726015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a7b3-e41b-4f99-867d-5f4143ed8d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.726291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a7b3-e41b-4f99-867d-5f4143ed8d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.726569 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a7b3-e41b-4f99-867d-5f4143ed8d2e admin admin] PATH_INFO: `/v3/projects/02e7b7a34eba42b5af9a277663d41484/users/807a590c646d417e9e991b1623175706/roles/531d1ead7d164c708ad131b14d2f9301` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.741114 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a7b3-e41b-4f99-867d-5f4143ed8d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e7b7a34eba42b5af9a277663d41484, user_id=807a590c646d417e9e991b1623175706, role_id=531d1ead7d164c708ad131b14d2f9301)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:18.743881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a7b3-e41b-4f99-867d-5f4143ed8d2e admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:18.757033 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1431/2861] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 16 00:32:18 2022] PUT /identity/v3/projects/02e7b7a34eba42b5af9a277663d41484/users/807a590c646d417e9e991b1623175706/roles/531d1ead7d164c708ad131b14d2f9301 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:18.762143 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2710e-1af1-4c4d-8cec-cabd332aba18 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.762437 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2710e-1af1-4c4d-8cec-cabd332aba18 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.762717 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2710e-1af1-4c4d-8cec-cabd332aba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.781557 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-69f2710e-1af1-4c4d-8cec-cabd332aba18 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:18.782831 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-69f2710e-1af1-4c4d-8cec-cabd332aba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:18.847584 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1431/2862] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:18.858455 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a7b3-e41b-4f99-867d-5f4143ed8d2e admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:18.860313 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c699a7b3-e41b-4f99-867d-5f4143ed8d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:18.880601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:18.936424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a7b3-e41b-4f99-867d-5f4143ed8d2e admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:18.940632 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111a39b-6033-47a2-b9db-86f0312a3490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:18.941548 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111a39b-6033-47a2-b9db-86f0312a3490 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:18.941874 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111a39b-6033-47a2-b9db-86f0312a3490 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:18.942113 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111a39b-6033-47a2-b9db-86f0312a3490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:18.951624 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111a39b-6033-47a2-b9db-86f0312a3490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:18.953096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111a39b-6033-47a2-b9db-86f0312a3490 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:18.963580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1432/2863] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:19.690003 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256db41-fce4-4cb4-9b5f-fe13eb6e939c None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:19.690546 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256db41-fce4-4cb4-9b5f-fe13eb6e939c None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:19.690786 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256db41-fce4-4cb4-9b5f-fe13eb6e939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:19.721303 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-6256db41-fce4-4cb4-9b5f-fe13eb6e939c None None] MFA Rules not processed for user `807a590c646d417e9e991b1623175706`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:19.722816 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-6256db41-fce4-4cb4-9b5f-fe13eb6e939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:19.750736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:19.811767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1432/2864] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:19.822312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111a39b-6033-47a2-b9db-86f0312a3490 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:19.824767 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-b111a39b-6033-47a2-b9db-86f0312a3490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:19.939940 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111a39b-6033-47a2-b9db-86f0312a3490 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:19.948701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f43a28-fd52-4ab3-9922-5e66c4aa1793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e658f3947f41a9a3e09ea327b5d8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:19.949920 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f43a28-fd52-4ab3-9922-5e66c4aa1793 service cinder] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:19.951148 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f43a28-fd52-4ab3-9922-5e66c4aa1793 service cinder] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:19.951592 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f43a28-fd52-4ab3-9922-5e66c4aa1793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:19.983032 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f43a28-fd52-4ab3-9922-5e66c4aa1793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:19.985061 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f43a28-fd52-4ab3-9922-5e66c4aa1793 service cinder] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:20.003841 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1433/2865] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:20.365258 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72af2bc-e80c-4bbf-affe-29bc39b2932d None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:20.365700 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72af2bc-e80c-4bbf-affe-29bc39b2932d None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:20.366619 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72af2bc-e80c-4bbf-affe-29bc39b2932d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:20.394552 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-c72af2bc-e80c-4bbf-affe-29bc39b2932d None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:20.396011 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-c72af2bc-e80c-4bbf-affe-29bc39b2932d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:20.481892 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1433/2866] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 16 00:32:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:20.496260 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f43a28-fd52-4ab3-9922-5e66c4aa1793 service cinder] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:20.498454 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-f7f43a28-fd52-4ab3-9922-5e66c4aa1793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:20.598085 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f43a28-fd52-4ab3-9922-5e66c4aa1793 service cinder] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:20.604033 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de830fa-4cd7-4101-9e5c-b2ab34823b6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:20.604981 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de830fa-4cd7-4101-9e5c-b2ab34823b6e service swift] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:20.605109 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de830fa-4cd7-4101-9e5c-b2ab34823b6e service swift] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:20.605383 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de830fa-4cd7-4101-9e5c-b2ab34823b6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:20.615369 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de830fa-4cd7-4101-9e5c-b2ab34823b6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:20.617622 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de830fa-4cd7-4101-9e5c-b2ab34823b6e service swift] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:20.637873 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1434/2867] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:32:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:21.511949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ff342-859c-4480-852d-87c1a8ed1a6b None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:21.512513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ff342-859c-4480-852d-87c1a8ed1a6b None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:21.512513 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ff342-859c-4480-852d-87c1a8ed1a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:21.568023 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-498ff342-859c-4480-852d-87c1a8ed1a6b None None] MFA Rules not processed for user `807a590c646d417e9e991b1623175706`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:21.570413 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-498ff342-859c-4480-852d-87c1a8ed1a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:21.582462 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1434/2868] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:32:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:29.098532 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de830fa-4cd7-4101-9e5c-b2ab34823b6e service swift] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:29.100071 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9de830fa-4cd7-4101-9e5c-b2ab34823b6e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:29.114620 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de830fa-4cd7-4101-9e5c-b2ab34823b6e service swift] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:29.119821 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:29.120736 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:29.121017 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:29.121290 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] PATH_INFO: `/v3/users/40a835515dd94db6a702778902f6be8f` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:29.122485 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a835515dd94db6a702778902f6be8f)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:29.124578 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:29.174067 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:29.176318 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a835515dd94db6a702778902f6be8f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.191972 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a835515dd94db6a702778902f6be8f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.192733 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a835515dd94db6a702778902f6be8f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.201357 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a835515dd94db6a702778902f6be8f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.209382 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a835515dd94db6a702778902f6be8f'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.215406 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1435/2869] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:32:29 2022] DELETE /identity/v3/users/40a835515dd94db6a702778902f6be8f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:29.463936 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ff342-859c-4480-852d-87c1a8ed1a6b None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:29.475447 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ff342-859c-4480-852d-87c1a8ed1a6b None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:29.535904 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:29.536818 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:29.537096 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:29.537406 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] PATH_INFO: `/v3/projects/c82e25e0940b4c2abbd71bd3032a4825` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:29.538610 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82e25e0940b4c2abbd71bd3032a4825)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:29.540576 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:29.588275 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82e25e0940b4c2abbd71bd3032a4825', 'request_id': 'req-76c98559-2235-4347-8861-7e8b0a56a777'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.595334 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82e25e0940b4c2abbd71bd3032a4825', 'request_id': 'req-76c98559-2235-4347-8861-7e8b0a56a777'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.599298 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:29.602458 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82e25e0940b4c2abbd71bd3032a4825', 'request_id': 'req-76c98559-2235-4347-8861-7e8b0a56a777'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.616698 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] The token cache is being invalidate because project c82e25e0940b4c2abbd71bd3032a4825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:32:29.616990 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.617656 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.619217 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1435/2870] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:32:29 2022] DELETE /identity/v3/projects/c82e25e0940b4c2abbd71bd3032a4825 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:29.623478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:29.624884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:29.637880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc49f84-87f6-4f95-9543-9651aa953ddb admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:29.692486 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:29.693350 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:29.693661 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:29.693941 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] PATH_INFO: `/v3/users/3f9226f418214e0584ea1458d0547952` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:29.695142 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9226f418214e0584ea1458d0547952)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:29.697069 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:29.742358 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9226f418214e0584ea1458d0547952'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.754221 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9226f418214e0584ea1458d0547952'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.754842 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9226f418214e0584ea1458d0547952'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.762359 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9226f418214e0584ea1458d0547952'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.772676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9226f418214e0584ea1458d0547952'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:29.781737 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1436/2871] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:32:29 2022] DELETE /identity/v3/users/3f9226f418214e0584ea1458d0547952 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:29.970301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:29.972050 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:29.990068 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c98559-2235-4347-8861-7e8b0a56a777 admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:30.092388 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:30.093065 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:30.093361 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:30.094641 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] PATH_INFO: `/v3/projects/1ee9906f5d5c466a877b782ffc23d8e1` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:30.095885 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee9906f5d5c466a877b782ffc23d8e1)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:30.097837 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:30.143942 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee9906f5d5c466a877b782ffc23d8e1', 'request_id': 'req-90cf0b2d-3780-49a2-98b7-1702d5583584'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:30.151515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee9906f5d5c466a877b782ffc23d8e1', 'request_id': 'req-90cf0b2d-3780-49a2-98b7-1702d5583584'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:30.156913 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee9906f5d5c466a877b782ffc23d8e1', 'request_id': 'req-90cf0b2d-3780-49a2-98b7-1702d5583584'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:30.168277 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] The token cache is being invalidate because project 1ee9906f5d5c466a877b782ffc23d8e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81055) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:32:30.168564 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:30.169179 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-90cf0b2d-3780-49a2-98b7-1702d5583584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:32:30.170725 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1436/2872] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:32:29 2022] DELETE /identity/v3/projects/1ee9906f5d5c466a877b782ffc23d8e1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:32:39.775096 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=66,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:40.165284 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=8,keystone:SELECT=55,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:42.544154 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:42.545684 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:42.605342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada17a0-f331-44c1-8ad8-4c39a3cd33cf admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:42.653643 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222e1d5-753c-4fc2-bf21-324b64249911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c142f4d77b54982abcd4b76edbcb4c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:42.654295 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e1d5-753c-4fc2-bf21-324b64249911 service neutron] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:42.654580 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e1d5-753c-4fc2-bf21-324b64249911 service neutron] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:42.654858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e1d5-753c-4fc2-bf21-324b64249911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:42.656658 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0222e1d5-753c-4fc2-bf21-324b64249911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:42.719718 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222e1d5-753c-4fc2-bf21-324b64249911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:42.721116 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222e1d5-753c-4fc2-bf21-324b64249911 service neutron] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:42.731342 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1437/2873] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:52.726933 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=70 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:56.567104 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386613-a744-4c22-83bb-76d9a0d1dfc9 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:56.567567 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386613-a744-4c22-83bb-76d9a0d1dfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:56.567666 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62386613-a744-4c22-83bb-76d9a0d1dfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:56.586903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-62386613-a744-4c22-83bb-76d9a0d1dfc9 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:56.588138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-62386613-a744-4c22-83bb-76d9a0d1dfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:56.646424 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1437/2874] 10.222.0.15 () {58 vars in 1016 bytes} [Thu Jun 16 00:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:56.667341 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222e1d5-753c-4fc2-bf21-324b64249911 service neutron] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:56.669019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0222e1d5-753c-4fc2-bf21-324b64249911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:56.740659 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222e1d5-753c-4fc2-bf21-324b64249911 service neutron] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:56.746075 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc86114-55b3-4978-9e15-df90fc708e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:56.746717 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc86114-55b3-4978-9e15-df90fc708e49 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:56.747006 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc86114-55b3-4978-9e15-df90fc708e49 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:56.747284 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc86114-55b3-4978-9e15-df90fc708e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:56.755480 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc86114-55b3-4978-9e15-df90fc708e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:56.757673 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc86114-55b3-4978-9e15-df90fc708e49 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:56.767019 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1438/2875] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:59.605767 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eac459-a7aa-4bfc-9cdb-2875a6a12c41 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:59.606367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eac459-a7aa-4bfc-9cdb-2875a6a12c41 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:59.606367 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eac459-a7aa-4bfc-9cdb-2875a6a12c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:59.625777 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-e9eac459-a7aa-4bfc-9cdb-2875a6a12c41 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:59.626984 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e9eac459-a7aa-4bfc-9cdb-2875a6a12c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:59.634874 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1438/2876] 10.222.0.15 () {58 vars in 1016 bytes} [Thu Jun 16 00:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:32:59.651328 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc86114-55b3-4978-9e15-df90fc708e49 service nova] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:59.653371 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7fc86114-55b3-4978-9e15-df90fc708e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:59.668683 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc86114-55b3-4978-9e15-df90fc708e49 service nova] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:59.674478 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6adc4-ce58-43f9-8133-2938ce92724f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:59.675155 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6adc4-ce58-43f9-8133-2938ce92724f service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:59.675439 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6adc4-ce58-43f9-8133-2938ce92724f service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:59.675839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6adc4-ce58-43f9-8133-2938ce92724f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:59.684650 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6adc4-ce58-43f9-8133-2938ce92724f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:59.686271 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6adc4-ce58-43f9-8133-2938ce92724f service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:59.696292 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1439/2877] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:59.697802 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eac459-a7aa-4bfc-9cdb-2875a6a12c41 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:59.699247 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-e9eac459-a7aa-4bfc-9cdb-2875a6a12c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:59.768493 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eac459-a7aa-4bfc-9cdb-2875a6a12c41 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:59.774330 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf1ae6-4a2b-4a87-98bf-804952bd0d10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dde39c6d85446a681dea24573f0d6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:59.774982 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf1ae6-4a2b-4a87-98bf-804952bd0d10 service placement] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:59.775286 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf1ae6-4a2b-4a87-98bf-804952bd0d10 service placement] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:59.775568 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf1ae6-4a2b-4a87-98bf-804952bd0d10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:59.777355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-4bcf1ae6-4a2b-4a87-98bf-804952bd0d10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:59.789868 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf1ae6-4a2b-4a87-98bf-804952bd0d10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:59.791471 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf1ae6-4a2b-4a87-98bf-804952bd0d10 service placement] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:59.801749 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1439/2878] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:02.848007 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1b01-ae5b-4b64-a33f-ee1ff2d3c549 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:02.848546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1b01-ae5b-4b64-a33f-ee1ff2d3c549 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:02.848546 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1b01-ae5b-4b64-a33f-ee1ff2d3c549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:02.866625 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-417c1b01-ae5b-4b64-a33f-ee1ff2d3c549 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:02.868446 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-417c1b01-ae5b-4b64-a33f-ee1ff2d3c549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:02.876146 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1440/2879] 10.222.0.15 () {58 vars in 1016 bytes} [Thu Jun 16 00:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:02.889962 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf1ae6-4a2b-4a87-98bf-804952bd0d10 service placement] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:02.906355 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf1ae6-4a2b-4a87-98bf-804952bd0d10 service placement] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:02.912166 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7e4a7-9337-43f6-b605-2fc57eeae8e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:02.912866 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7e4a7-9337-43f6-b605-2fc57eeae8e5 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:02.913157 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7e4a7-9337-43f6-b605-2fc57eeae8e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:02.913431 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7e4a7-9337-43f6-b605-2fc57eeae8e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:02.922498 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7e4a7-9337-43f6-b605-2fc57eeae8e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:02.924128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7e4a7-9337-43f6-b605-2fc57eeae8e5 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:02.934225 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1440/2880] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:05.930899 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c405e4-1b1b-4ed7-8c6f-13b18d9df355 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:05.931403 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c405e4-1b1b-4ed7-8c6f-13b18d9df355 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:05.931511 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c405e4-1b1b-4ed7-8c6f-13b18d9df355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:05.950306 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-71c405e4-1b1b-4ed7-8c6f-13b18d9df355 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:05.951496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-71c405e4-1b1b-4ed7-8c6f-13b18d9df355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:05.959662 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1441/2881] 10.222.0.15 () {58 vars in 1016 bytes} [Thu Jun 16 00:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:05.974628 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7e4a7-9337-43f6-b605-2fc57eeae8e5 service nova] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:05.986100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7e4a7-9337-43f6-b605-2fc57eeae8e5 service nova] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:05.992080 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f101aad-fcd9-4ca9-8ee8-7078c9029916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:05.992723 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f101aad-fcd9-4ca9-8ee8-7078c9029916 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:05.993015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f101aad-fcd9-4ca9-8ee8-7078c9029916 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:05.993295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f101aad-fcd9-4ca9-8ee8-7078c9029916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:06.001830 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f101aad-fcd9-4ca9-8ee8-7078c9029916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:06.003401 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f101aad-fcd9-4ca9-8ee8-7078c9029916 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:06.013433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1441/2882] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:09.090001 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc264c9-cb28-4f31-ab84-f4f21b64fedb None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:09.090507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc264c9-cb28-4f31-ab84-f4f21b64fedb None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:09.090612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc264c9-cb28-4f31-ab84-f4f21b64fedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:09.108722 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-4dc264c9-cb28-4f31-ab84-f4f21b64fedb None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:09.109943 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-4dc264c9-cb28-4f31-ab84-f4f21b64fedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:09.118484 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1442/2883] 10.222.0.15 () {58 vars in 1016 bytes} [Thu Jun 16 00:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:09.137057 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f101aad-fcd9-4ca9-8ee8-7078c9029916 service nova] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:09.148326 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f101aad-fcd9-4ca9-8ee8-7078c9029916 service nova] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:09.153858 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37181651-a503-4b94-9689-73d4d8d58f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:09.154501 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37181651-a503-4b94-9689-73d4d8d58f65 service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:09.154793 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37181651-a503-4b94-9689-73d4d8d58f65 service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:09.155074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37181651-a503-4b94-9689-73d4d8d58f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:09.163511 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37181651-a503-4b94-9689-73d4d8d58f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:09.165128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37181651-a503-4b94-9689-73d4d8d58f65 service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:09.174928 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1442/2884] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:12.249038 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08608d-ff0d-47fa-acf5-aaac76e170ad None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:12.249497 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08608d-ff0d-47fa-acf5-aaac76e170ad None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:12.249612 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08608d-ff0d-47fa-acf5-aaac76e170ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:12.267519 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-7b08608d-ff0d-47fa-acf5-aaac76e170ad None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:12.268816 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-7b08608d-ff0d-47fa-acf5-aaac76e170ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:12.277507 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1443/2885] 10.222.0.15 () {58 vars in 1016 bytes} [Thu Jun 16 00:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:12.296368 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37181651-a503-4b94-9689-73d4d8d58f65 service nova] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:12.307442 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37181651-a503-4b94-9689-73d4d8d58f65 service nova] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:12.313028 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe2067-5912-4c3f-bfc8-2b789fb55d7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:12.313699 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe2067-5912-4c3f-bfc8-2b789fb55d7e service nova] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:12.313985 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe2067-5912-4c3f-bfc8-2b789fb55d7e service nova] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:12.314269 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe2067-5912-4c3f-bfc8-2b789fb55d7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:12.323312 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe2067-5912-4c3f-bfc8-2b789fb55d7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:12.324917 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe2067-5912-4c3f-bfc8-2b789fb55d7e service nova] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:12.334270 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1443/2886] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:22.262583 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=52 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:22.330066 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=86 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:27.284529 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfacb73-9b35-4ab8-9a25-0f9dbfa697e8 None None] REQUEST_METHOD: `POST` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:27.285020 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfacb73-9b35-4ab8-9a25-0f9dbfa697e8 None None] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:27.285129 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfacb73-9b35-4ab8-9a25-0f9dbfa697e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:27.301979 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.auth.core [None req-0bfacb73-9b35-4ab8-9a25-0f9dbfa697e8 None None] MFA Rules not processed for user `807a590c646d417e9e991b1623175706`. Rule list: `[]` (Enabled: `True`). {{(pid=81054) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:27.303170 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-0bfacb73-9b35-4ab8-9a25-0f9dbfa697e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:27.355986 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1444/2887] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 16 00:33:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:37.349398 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=25 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:39.854299 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b748a6-f61a-4c4b-abec-7d0d4f34ee72 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:39.854840 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b748a6-f61a-4c4b-abec-7d0d4f34ee72 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:39.854950 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b748a6-f61a-4c4b-abec-7d0d4f34ee72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:39.873245 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-23b748a6-f61a-4c4b-abec-7d0d4f34ee72 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:39.874453 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-23b748a6-f61a-4c4b-abec-7d0d4f34ee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:39.882287 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1444/2888] 10.222.0.15 () {58 vars in 1016 bytes} [Thu Jun 16 00:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:39.897424 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfacb73-9b35-4ab8-9a25-0f9dbfa697e8 None None] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:39.910160 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfacb73-9b35-4ab8-9a25-0f9dbfa697e8 None None] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:39.915391 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1d0c8-f3bf-4425-9a32-1d591ff1b232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:39.916575 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d0c8-f3bf-4425-9a32-1d591ff1b232 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:39.916858 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d0c8-f3bf-4425-9a32-1d591ff1b232 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:39.917134 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d0c8-f3bf-4425-9a32-1d591ff1b232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:39.926305 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1d0c8-f3bf-4425-9a32-1d591ff1b232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:39.927863 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1d0c8-f3bf-4425-9a32-1d591ff1b232 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:39.938012 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1445/2889] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:43.120697 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c2e5-536e-4c46-ae58-5f5c2ef10446 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:43.121295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c2e5-536e-4c46-ae58-5f5c2ef10446 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:43.121295 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c2e5-536e-4c46-ae58-5f5c2ef10446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:43.139265 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-fe71c2e5-536e-4c46-ae58-5f5c2ef10446 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:43.140497 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-fe71c2e5-536e-4c46-ae58-5f5c2ef10446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:43.148267 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1445/2890] 10.222.0.15 () {58 vars in 1016 bytes} [Thu Jun 16 00:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:43.164300 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1d0c8-f3bf-4425-9a32-1d591ff1b232 service nova] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:43.175445 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1d0c8-f3bf-4425-9a32-1d591ff1b232 service nova] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:43.180931 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bce363-1c02-4368-85c9-ca1061a1ea60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:43.181564 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bce363-1c02-4368-85c9-ca1061a1ea60 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:43.181850 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bce363-1c02-4368-85c9-ca1061a1ea60 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:43.182132 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bce363-1c02-4368-85c9-ca1061a1ea60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:43.190419 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bce363-1c02-4368-85c9-ca1061a1ea60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:43.192008 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bce363-1c02-4368-85c9-ca1061a1ea60 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:43.201982 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1446/2891] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:46.190026 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abfa88-ef31-498b-98f1-1d1cb397ad79 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:46.190515 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abfa88-ef31-498b-98f1-1d1cb397ad79 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:46.190630 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abfa88-ef31-498b-98f1-1d1cb397ad79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:46.208074 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-63abfa88-ef31-498b-98f1-1d1cb397ad79 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:46.209301 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-63abfa88-ef31-498b-98f1-1d1cb397ad79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:46.217317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1446/2892] 10.222.0.15 () {58 vars in 1016 bytes} [Thu Jun 16 00:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:46.232666 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bce363-1c02-4368-85c9-ca1061a1ea60 service nova] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:46.244573 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bce363-1c02-4368-85c9-ca1061a1ea60 service nova] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:46.249942 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c865cf-ac31-4217-a659-019c6602c369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:46.250601 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c865cf-ac31-4217-a659-019c6602c369 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:46.250884 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c865cf-ac31-4217-a659-019c6602c369 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:46.251162 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c865cf-ac31-4217-a659-019c6602c369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:46.259042 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c865cf-ac31-4217-a659-019c6602c369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:46.260644 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c865cf-ac31-4217-a659-019c6602c369 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:46.270015 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1447/2893] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:49.344597 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0254192-81dd-4283-9179-c447e8a8f1a6 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:49.345100 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0254192-81dd-4283-9179-c447e8a8f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:49.345205 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0254192-81dd-4283-9179-c447e8a8f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:49.363109 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-d0254192-81dd-4283-9179-c447e8a8f1a6 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:49.364322 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-d0254192-81dd-4283-9179-c447e8a8f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:49.372276 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1447/2894] 10.222.0.15 () {58 vars in 1016 bytes} [Thu Jun 16 00:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:49.393255 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c865cf-ac31-4217-a659-019c6602c369 service nova] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:49.405224 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c865cf-ac31-4217-a659-019c6602c369 service nova] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:49.410544 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e5d20-9000-49bd-97a2-0a115e361e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:49.411181 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e5d20-9000-49bd-97a2-0a115e361e38 service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:49.411467 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e5d20-9000-49bd-97a2-0a115e361e38 service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:49.411746 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e5d20-9000-49bd-97a2-0a115e361e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:49.420496 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e5d20-9000-49bd-97a2-0a115e361e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:49.422065 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e5d20-9000-49bd-97a2-0a115e361e38 service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:49.431263 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1448/2895] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:52.503719 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec5b94-96e5-4067-bd05-c872015c69a5 None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:52.504231 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec5b94-96e5-4067-bd05-c872015c69a5 None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:52.504331 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec5b94-96e5-4067-bd05-c872015c69a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:52.522801 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-beec5b94-96e5-4067-bd05-c872015c69a5 None None] MFA Rules not processed for user `7c97d5b600dd47ebad51152c916a100a`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:52.524037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-beec5b94-96e5-4067-bd05-c872015c69a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:52.531834 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1448/2896] 10.222.0.15 () {58 vars in 1016 bytes} [Thu Jun 16 00:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:52.552133 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e5d20-9000-49bd-97a2-0a115e361e38 service nova] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:52.563531 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e5d20-9000-49bd-97a2-0a115e361e38 service nova] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:52.569136 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2198-58ce-4196-b308-685c104a221b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd57046b084b463488296b825097081d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:52.569763 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2198-58ce-4196-b308-685c104a221b service nova] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:52.570047 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2198-58ce-4196-b308-685c104a221b service nova] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:52.570319 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2198-58ce-4196-b308-685c104a221b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:52.578999 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae2198-58ce-4196-b308-685c104a221b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:52.580607 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae2198-58ce-4196-b308-685c104a221b service nova] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:52.590119 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1449/2897] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:34:02.517794 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=15 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:02.585783 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=30 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:21.403654 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec5b94-96e5-4067-bd05-c872015c69a5 None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:21.405317 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-beec5b94-96e5-4067-bd05-c872015c69a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:21.421369 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec5b94-96e5-4067-bd05-c872015c69a5 None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:21.427390 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e2d5b-b75e-4159-a6d8-cc91269cab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:21.428320 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e2d5b-b75e-4159-a6d8-cc91269cab65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:21.428608 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e2d5b-b75e-4159-a6d8-cc91269cab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:21.429108 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e2d5b-b75e-4159-a6d8-cc91269cab65 admin admin] PATH_INFO: `/v3/users/807a590c646d417e9e991b1623175706` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:21.430351 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e2d5b-b75e-4159-a6d8-cc91269cab65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=807a590c646d417e9e991b1623175706)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:21.432726 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e2d5b-b75e-4159-a6d8-cc91269cab65 admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:21.491753 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-303e2d5b-b75e-4159-a6d8-cc91269cab65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807a590c646d417e9e991b1623175706'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:21.492593 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-303e2d5b-b75e-4159-a6d8-cc91269cab65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807a590c646d417e9e991b1623175706'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:21.508906 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-303e2d5b-b75e-4159-a6d8-cc91269cab65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807a590c646d417e9e991b1623175706'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:21.509964 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-303e2d5b-b75e-4159-a6d8-cc91269cab65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807a590c646d417e9e991b1623175706'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:21.528518 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-303e2d5b-b75e-4159-a6d8-cc91269cab65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807a590c646d417e9e991b1623175706'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:21.561765 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1449/2898] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:34:21 2022] DELETE /identity/v3/users/807a590c646d417e9e991b1623175706 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:34:21.765407 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2198-58ce-4196-b308-685c104a221b service nova] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:21.776745 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2198-58ce-4196-b308-685c104a221b service nova] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:21.835447 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:21.836285 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:21.836574 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:21.836857 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] PATH_INFO: `/v3/projects/02e7b7a34eba42b5af9a277663d41484` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:21.838066 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e7b7a34eba42b5af9a277663d41484)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:21.840664 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:21.893294 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e7b7a34eba42b5af9a277663d41484', 'request_id': 'req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:21.901432 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e7b7a34eba42b5af9a277663d41484', 'request_id': 'req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:21.908204 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e7b7a34eba42b5af9a277663d41484', 'request_id': 'req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:21.922291 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] The token cache is being invalidate because project 02e7b7a34eba42b5af9a277663d41484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:34:21.922614 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:21.923239 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:21.927998 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1450/2899] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:34:21 2022] DELETE /identity/v3/projects/02e7b7a34eba42b5af9a277663d41484 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:34:22.727021 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646eec6-bd3e-424d-89b6-8a495c9f988f None None] REQUEST_METHOD: `POST` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:22.727478 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646eec6-bd3e-424d-89b6-8a495c9f988f None None] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:22.727572 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646eec6-bd3e-424d-89b6-8a495c9f988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:22.748088 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.auth.core [None req-f646eec6-bd3e-424d-89b6-8a495c9f988f None None] MFA Rules not processed for user `1fc6d76795694d91b41b8bf819728aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81055) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:34:22.749289 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f646eec6-bd3e-424d-89b6-8a495c9f988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:22.802820 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1450/2900] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 16 00:34:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:34:22.842570 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:22.844005 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:22.911994 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13a13-de6f-4060-ba6c-b06cce0e6aa5 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:22.916913 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2c162-d972-41d8-aa23-cd67b308e824 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d67d41124c4deda1c5ecdab82d3055', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:22.917559 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2c162-d972-41d8-aa23-cd67b308e824 service swift] REQUEST_METHOD: `GET` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:22.918415 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2c162-d972-41d8-aa23-cd67b308e824 service swift] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:22.918701 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2c162-d972-41d8-aa23-cd67b308e824 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:22.926700 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2c162-d972-41d8-aa23-cd67b308e824 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:22.928312 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2c162-d972-41d8-aa23-cd67b308e824 service swift] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:22.937327 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1451/2901] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 16 00:34:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:34:29.373604 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646eec6-bd3e-424d-89b6-8a495c9f988f None None] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:29.375078 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-f646eec6-bd3e-424d-89b6-8a495c9f988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:29.440636 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646eec6-bd3e-424d-89b6-8a495c9f988f None None] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:29.445093 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:29.445972 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:29.446259 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:29.446538 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] PATH_INFO: `/v3/users/8ef80bd718504406a7a037fd96ce165c` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:29.447744 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef80bd718504406a7a037fd96ce165c)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:29.449740 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:29.470292 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:29.495222 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef80bd718504406a7a037fd96ce165c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.496399 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef80bd718504406a7a037fd96ce165c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.507949 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef80bd718504406a7a037fd96ce165c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.508599 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef80bd718504406a7a037fd96ce165c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.515735 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef80bd718504406a7a037fd96ce165c'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.527669 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1451/2902] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:34:29 2022] DELETE /identity/v3/users/8ef80bd718504406a7a037fd96ce165c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:34:29.701711 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2c162-d972-41d8-aa23-cd67b308e824 service swift] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:29.713909 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2c162-d972-41d8-aa23-cd67b308e824 service swift] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:29.732778 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:29.772881 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:29.773665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:29.773951 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:29.774227 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] PATH_INFO: `/v3/projects/717393116b6641888a8160ffbbebae34` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:29.775390 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717393116b6641888a8160ffbbebae34)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:29.777839 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:29.821880 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717393116b6641888a8160ffbbebae34', 'request_id': 'req-c8a1b50b-e515-4ae8-a633-4ddcdf489713'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.828257 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717393116b6641888a8160ffbbebae34', 'request_id': 'req-c8a1b50b-e515-4ae8-a633-4ddcdf489713'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.833748 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717393116b6641888a8160ffbbebae34', 'request_id': 'req-c8a1b50b-e515-4ae8-a633-4ddcdf489713'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.845268 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] The token cache is being invalidate because project 717393116b6641888a8160ffbbebae34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:34:29.845560 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.846187 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.847719 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1452/2903] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:34:29 2022] DELETE /identity/v3/projects/717393116b6641888a8160ffbbebae34 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:34:29.852037 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:29.853433 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:29.867215 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166232b-e474-41a8-8d69-384d80f7bf6a admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:29.922507 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:29.923374 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:29.923660 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:29.923941 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] PATH_INFO: `/v3/users/853f7d82cfc443b1a2681c424e21f8d9` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:29.925138 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] RBAC: Authorizing `identity:delete_user(user_id=853f7d82cfc443b1a2681c424e21f8d9)` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:29.927041 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:29.971128 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853f7d82cfc443b1a2681c424e21f8d9'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.971846 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853f7d82cfc443b1a2681c424e21f8d9'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.984518 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853f7d82cfc443b1a2681c424e21f8d9'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.985180 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853f7d82cfc443b1a2681c424e21f8d9'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:29.992297 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.notifications [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853f7d82cfc443b1a2681c424e21f8d9'} {{(pid=81055) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:30.004492 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1452/2904] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 16 00:34:29 2022] DELETE /identity/v3/users/853f7d82cfc443b1a2681c424e21f8d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:34:30.180120 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] Authenticating user token {{(pid=81054) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:34:30.181630 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.fernet_utils [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81054) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:34:30.196584 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1b50b-e515-4ae8-a633-4ddcdf489713 admin admin] Validating token access rules against request {{(pid=81054) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:34:30.254514 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c97d5b600dd47ebad51152c916a100a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f6ff6bbe76344e7a7f939e30a88483a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81054) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:34:30.255380 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:34:30.255665 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:34:30.255944 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] PATH_INFO: `/v3/projects/41ba65d2983043d284dadecc8cf8c95a` {{(pid=81054) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:34:30.257168 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ba65d2983043d284dadecc8cf8c95a)` {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:34:30.259080 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] RBAC: Authorization granted {{(pid=81054) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:34:30.304423 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ba65d2983043d284dadecc8cf8c95a', 'request_id': 'req-b5cd291b-7b6e-406f-a9c3-e41c5990b468'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:30.306774 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:30.312621 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ba65d2983043d284dadecc8cf8c95a', 'request_id': 'req-b5cd291b-7b6e-406f-a9c3-e41c5990b468'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:30.320046 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ba65d2983043d284dadecc8cf8c95a', 'request_id': 'req-b5cd291b-7b6e-406f-a9c3-e41c5990b468'} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:30.331215 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] The token cache is being invalidate because project 41ba65d2983043d284dadecc8cf8c95a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81054) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:34:30.331502 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:30.332152 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG keystone.notifications [None req-b5cd291b-7b6e-406f-a9c3-e41c5990b468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81054) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:34:30.333676 dv-cinder-845990-2-smb devstack@keystone.service[81054]: [pid: 81054|app: 0|req: 1453/2905] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 16 00:34:30 2022] DELETE /identity/v3/projects/41ba65d2983043d284dadecc8cf8c95a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:34:40.001054 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:DELETE=18,keystone:SELECT=73,keystone:INSERT=2 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:40.328426 dv-cinder-845990-2-smb devstack@keystone.service[81054]: DEBUG dbcounter [-] [81054] Writing DB stats keystone:DELETE=3,keystone:SELECT=6 {{(pid=81054) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:06.658653 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] Authenticating user token {{(pid=81055) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.660082 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.796218 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5d981-49ef-4380-9ea6-872d4335c31b admin admin] Validating token access rules against request {{(pid=81055) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.852800 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51951e7d-1c9c-4a9f-8130-a0f85532be64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dde39c6d85446a681dea24573f0d6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72db4b8f1ac74714add3893ac61f7d8a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81055) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.853450 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951e7d-1c9c-4a9f-8130-a0f85532be64 service placement] REQUEST_METHOD: `GET` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.853736 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951e7d-1c9c-4a9f-8130-a0f85532be64 service placement] SCRIPT_NAME: `/identity` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.854015 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951e7d-1c9c-4a9f-8130-a0f85532be64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81055) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.855758 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.fernet_utils [None req-51951e7d-1c9c-4a9f-8130-a0f85532be64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81055) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.866665 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51951e7d-1c9c-4a9f-8130-a0f85532be64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.868252 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51951e7d-1c9c-4a9f-8130-a0f85532be64 service placement] RBAC: Authorization granted {{(pid=81055) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.877903 dv-cinder-845990-2-smb devstack@keystone.service[81055]: [pid: 81055|app: 0|req: 1453/2906] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:16.873766 dv-cinder-845990-2-smb devstack@keystone.service[81055]: DEBUG dbcounter [-] [81055] Writing DB stats keystone:SELECT=89 {{(pid=81055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}